[PR #4669] [MERGED] Simplify cache condition for LMStudio and Ollama to prevent race condition #4708

Closed
opened 2026-02-22 18:36:22 -05:00 by yindo · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/Mintplex-Labs/anything-llm/pull/4669
Author: @timothycarambat
Created: 11/20/2025
Status: Merged
Merged: 11/20/2025
Merged by: @timothycarambat

Base: masterHead: ollama-lmstudio-cache-race


📝 Commits (1)

  • f5fec75 Simplify cache condition for LMStudio and Ollama to prevent race condition

📊 Changes

2 files changed (+51 additions, -21 deletions)

View changed files

📝 server/utils/AiProviders/lmStudio/index.js (+26 -11)
📝 server/utils/AiProviders/ollama/index.js (+25 -10)

📄 Description

Pull Request Type

  • feat
  • 🐛 fix
  • ♻️ refactor
  • 💄 style
  • 🔨 chore
  • 📝 docs

Relevant Issues

closes #4597
resolves #4572
closes #4600
resolves #4599

What is in this change?

  • Resolves possible race condition on chat inference for LMStudio or Ollama providers, where we want to infer more accurate chat context windows if undefined by the user.

Additional Information

Developer Validations

  • I ran yarn lint from the root of the repo & committed changes
  • Relevant documentation has been updated
  • I have tested my code functionality
  • Docker build succeeds locally

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/Mintplex-Labs/anything-llm/pull/4669 **Author:** [@timothycarambat](https://github.com/timothycarambat) **Created:** 11/20/2025 **Status:** ✅ Merged **Merged:** 11/20/2025 **Merged by:** [@timothycarambat](https://github.com/timothycarambat) **Base:** `master` ← **Head:** `ollama-lmstudio-cache-race` --- ### 📝 Commits (1) - [`f5fec75`](https://github.com/Mintplex-Labs/anything-llm/commit/f5fec75a744c7945c3b7d26aa5ee06f40a85259d) Simplify cache condition for LMStudio and Ollama to prevent race condition ### 📊 Changes **2 files changed** (+51 additions, -21 deletions) <details> <summary>View changed files</summary> 📝 `server/utils/AiProviders/lmStudio/index.js` (+26 -11) 📝 `server/utils/AiProviders/ollama/index.js` (+25 -10) </details> ### 📄 Description ### Pull Request Type <!-- For change type, change [ ] to [x]. --> - [ ] ✨ feat - [x] 🐛 fix - [x] ♻️ refactor - [ ] 💄 style - [ ] 🔨 chore - [ ] 📝 docs ### Relevant Issues <!-- Use "resolves #xxx" to auto resolve on merge. Otherwise, please use "connect #xxx" --> closes #4597 resolves #4572 closes #4600 resolves #4599 ### What is in this change? - Resolves possible race condition on chat inference for LMStudio or Ollama providers, where we want to infer more accurate chat context windows if undefined by the user. <!-- Describe the changes in this PR that are impactful to the repo. --> ### Additional Information <!-- Add any other context about the Pull Request here that was not captured above. --> ### Developer Validations <!-- All of the applicable items should be checked. --> - [ ] I ran `yarn lint` from the root of the repo & committed changes - [ ] Relevant documentation has been updated - [ ] I have tested my code functionality - [ ] Docker build succeeds locally --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-22 18:36:22 -05:00
yindo closed this issue 2026-02-22 18:36:22 -05:00
yindo changed title from [PR #4669] Simplify cache condition for LMStudio and Ollama to prevent race condition to [PR #4669] [MERGED] Simplify cache condition for LMStudio and Ollama to prevent race condition 2026-06-05 15:19:57 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#4708