[PR #292] [MERGED] Compensate for upper OpenAI emedding limit chunk size #3287

Closed
opened 2026-02-22 18:33:28 -05:00 by yindo · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/Mintplex-Labs/anything-llm/pull/292
Author: @timothycarambat
Created: 10/26/2023
Status: Merged
Merged: 10/26/2023
Merged by: @timothycarambat

Base: masterHead: openai-embedding-limit


📝 Commits (1)

  • 806ccae Compensate for upper OpenAI emedding limit chunk size

📊 Changes

9 files changed (+81 additions, -24 deletions)

View changed files

📝 frontend/src/components/Modals/MangeWorkspace/Documents/index.jsx (+6 -6)
📝 server/endpoints/workspaces.js (+11 -2)
📝 server/models/documents.js (+5 -1)
📝 server/utils/AiProviders/openAi/index.js (+49 -5)
📝 server/utils/vectorDbProviders/chroma/index.js (+2 -2)
📝 server/utils/vectorDbProviders/lance/index.js (+2 -2)
📝 server/utils/vectorDbProviders/pinecone/index.js (+2 -2)
📝 server/utils/vectorDbProviders/qdrant/index.js (+2 -2)
📝 server/utils/vectorDbProviders/weaviate/index.js (+2 -2)

📄 Description

Limit is due to POST body max size. Sufficiently large requests will abort automatically.
We should report that error back on the frontend during embedding.
Update vectordb providers to return on failed


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/Mintplex-Labs/anything-llm/pull/292 **Author:** [@timothycarambat](https://github.com/timothycarambat) **Created:** 10/26/2023 **Status:** ✅ Merged **Merged:** 10/26/2023 **Merged by:** [@timothycarambat](https://github.com/timothycarambat) **Base:** `master` ← **Head:** `openai-embedding-limit` --- ### 📝 Commits (1) - [`806ccae`](https://github.com/Mintplex-Labs/anything-llm/commit/806ccae25d8dc47612f24c413bde232e915a0d9d) Compensate for upper OpenAI emedding limit chunk size ### 📊 Changes **9 files changed** (+81 additions, -24 deletions) <details> <summary>View changed files</summary> 📝 `frontend/src/components/Modals/MangeWorkspace/Documents/index.jsx` (+6 -6) 📝 `server/endpoints/workspaces.js` (+11 -2) 📝 `server/models/documents.js` (+5 -1) 📝 `server/utils/AiProviders/openAi/index.js` (+49 -5) 📝 `server/utils/vectorDbProviders/chroma/index.js` (+2 -2) 📝 `server/utils/vectorDbProviders/lance/index.js` (+2 -2) 📝 `server/utils/vectorDbProviders/pinecone/index.js` (+2 -2) 📝 `server/utils/vectorDbProviders/qdrant/index.js` (+2 -2) 📝 `server/utils/vectorDbProviders/weaviate/index.js` (+2 -2) </details> ### 📄 Description Limit is due to POST body max size. Sufficiently large requests will abort automatically. We should report that error back on the frontend during embedding. Update vectordb providers to return on failed --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-22 18:33:28 -05:00
yindo closed this issue 2026-02-22 18:33:28 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#3287