[PR #5721] [MERGED] apply universal sdk timeout #5542

Closed
opened 2026-06-05 15:21:40 -04:00 by yindo · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/Mintplex-Labs/anything-llm/pull/5721
Author: @timothycarambat
Created: 5/29/2026
Status: Merged
Merged: 6/2/2026
Merged by: @timothycarambat

Base: masterHead: 5637-timeouts


📝 Commits (2)

  • c1d6ea2 apply universal sdk timeout
  • 4bfc7c3 Merge branch 'master' into 5637-timeouts

📊 Changes

35 files changed (+103 additions, -32 deletions)

View changed files

📝 server/index.js (+1 -0)
📝 server/utils/agents/aibitat/providers/anthropic.js (+0 -1)
📝 server/utils/agents/aibitat/providers/apipie.js (+0 -1)
📝 server/utils/agents/aibitat/providers/cerebras.js (+0 -1)
📝 server/utils/agents/aibitat/providers/cometapi.js (+0 -1)
📝 server/utils/agents/aibitat/providers/deepseek.js (+0 -1)
📝 server/utils/agents/aibitat/providers/dockerModelRunner.js (+0 -1)
📝 server/utils/agents/aibitat/providers/fireworksai.js (+0 -1)
📝 server/utils/agents/aibitat/providers/foundry.js (+0 -1)
📝 server/utils/agents/aibitat/providers/gemini.js (+0 -1)
📝 server/utils/agents/aibitat/providers/genericOpenAi.js (+0 -1)
📝 server/utils/agents/aibitat/providers/giteeai.js (+0 -1)
📝 server/utils/agents/aibitat/providers/groq.js (+0 -1)
📝 server/utils/agents/aibitat/providers/koboldcpp.js (+0 -1)
📝 server/utils/agents/aibitat/providers/lemonade.js (+0 -1)
📝 server/utils/agents/aibitat/providers/litellm.js (+0 -1)
📝 server/utils/agents/aibitat/providers/lmstudio.js (+0 -1)
📝 server/utils/agents/aibitat/providers/localai.js (+0 -1)
📝 server/utils/agents/aibitat/providers/minimax.js (+0 -1)
📝 server/utils/agents/aibitat/providers/mistral.js (+0 -1)

...and 15 more files

📄 Description

Pull Request Type

  • feat (New feature)
  • 🐛 fix (Bug fix)
  • ♻️ refactor (Code refactoring without changing behavior)
  • 💄 style (UI style changes)
  • 🔨 chore (Build, CI, maintenance)
  • 📝 docs (Documentation updates)

Relevant Issues

resolves #5631
resolves #5603
resolves #5681
closes #5637

Description

  • Adds monkeypatch to openai and anthropic sdk layers to use a system level fetch undici Agent so the user can set a custom timeout.
  • Base timeout bumped to 10min
  • Removes maxRetries and sets them globally to 0 to get socket timeouts back sooner.
  • Adds these ENVs to updateENV for persistence.

Visuals (if applicable)

Additional Information

Developer Validations

  • I ran yarn lint from the root of the repo & committed changes
  • Relevant documentation has been updated (if applicable)
  • I have tested my code functionality
  • Docker build succeeds locally

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/Mintplex-Labs/anything-llm/pull/5721 **Author:** [@timothycarambat](https://github.com/timothycarambat) **Created:** 5/29/2026 **Status:** ✅ Merged **Merged:** 6/2/2026 **Merged by:** [@timothycarambat](https://github.com/timothycarambat) **Base:** `master` ← **Head:** `5637-timeouts` --- ### 📝 Commits (2) - [`c1d6ea2`](https://github.com/Mintplex-Labs/anything-llm/commit/c1d6ea27f384df65173adae335b8017abd054b53) apply universal sdk timeout - [`4bfc7c3`](https://github.com/Mintplex-Labs/anything-llm/commit/4bfc7c3d195a710c281df64caaef4012ef32cd03) Merge branch 'master' into 5637-timeouts ### 📊 Changes **35 files changed** (+103 additions, -32 deletions) <details> <summary>View changed files</summary> 📝 `server/index.js` (+1 -0) 📝 `server/utils/agents/aibitat/providers/anthropic.js` (+0 -1) 📝 `server/utils/agents/aibitat/providers/apipie.js` (+0 -1) 📝 `server/utils/agents/aibitat/providers/cerebras.js` (+0 -1) 📝 `server/utils/agents/aibitat/providers/cometapi.js` (+0 -1) 📝 `server/utils/agents/aibitat/providers/deepseek.js` (+0 -1) 📝 `server/utils/agents/aibitat/providers/dockerModelRunner.js` (+0 -1) 📝 `server/utils/agents/aibitat/providers/fireworksai.js` (+0 -1) 📝 `server/utils/agents/aibitat/providers/foundry.js` (+0 -1) 📝 `server/utils/agents/aibitat/providers/gemini.js` (+0 -1) 📝 `server/utils/agents/aibitat/providers/genericOpenAi.js` (+0 -1) 📝 `server/utils/agents/aibitat/providers/giteeai.js` (+0 -1) 📝 `server/utils/agents/aibitat/providers/groq.js` (+0 -1) 📝 `server/utils/agents/aibitat/providers/koboldcpp.js` (+0 -1) 📝 `server/utils/agents/aibitat/providers/lemonade.js` (+0 -1) 📝 `server/utils/agents/aibitat/providers/litellm.js` (+0 -1) 📝 `server/utils/agents/aibitat/providers/lmstudio.js` (+0 -1) 📝 `server/utils/agents/aibitat/providers/localai.js` (+0 -1) 📝 `server/utils/agents/aibitat/providers/minimax.js` (+0 -1) 📝 `server/utils/agents/aibitat/providers/mistral.js` (+0 -1) _...and 15 more files_ </details> ### 📄 Description ### Pull Request Type - [x] ✨ feat (New feature) - [ ] 🐛 fix (Bug fix) - [ ] ♻️ refactor (Code refactoring without changing behavior) - [ ] 💄 style (UI style changes) - [ ] 🔨 chore (Build, CI, maintenance) - [ ] 📝 docs (Documentation updates) ### Relevant Issues resolves #5631 resolves #5603 resolves #5681 closes #5637 ### Description - Adds monkeypatch to `openai` and `anthropic` sdk layers to use a system level fetch `undici` Agent so the user can set a custom timeout. - Base timeout bumped to 10min - Removes `maxRetries` and sets them globally to 0 to get socket timeouts back sooner. - Adds these ENVs to `updateENV` for persistence. <!-- Describe the changes in this PR that are impactful to the repo. What problem does it solve? --> ### Visuals (if applicable) <!-- Add screenshots or screen recordings to demonstrate the changes, especially for UI updates. --> ### Additional Information <!-- Add any other context about the Pull Request here that was not captured above. --> ### Developer Validations <!-- All of the applicable items should be checked. --> - [ ] I ran `yarn lint` from the root of the repo & committed changes - [ ] Relevant documentation has been updated (if applicable) - [ ] I have tested my code functionality - [ ] Docker build succeeds locally --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-06-05 15:21:40 -04:00
yindo closed this issue 2026-06-05 15:21:40 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#5542