[PR #415] [MERGED] feat: add support for variable chunk length #3348

Closed
opened 2026-02-22 18:33:36 -05:00 by yindo · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/Mintplex-Labs/anything-llm/pull/415
Author: @timothycarambat
Created: 12/7/2023
Status: Merged
Merged: 12/7/2023
Merged by: @timothycarambat

Base: masterHead: 388-embedding-max-token-size


📝 Commits (1)

  • 2eb1e73 feat: add support for variable chunk length

📊 Changes

15 files changed (+89 additions, -24 deletions)

View changed files

📝 docker/.env.example (+1 -0)
📝 frontend/src/components/EmbeddingSelection/LocalAiOptions/index.jsx (+16 -0)
📝 server/.env.example (+1 -0)
📝 server/models/systemSettings.js (+2 -0)
📝 server/utils/EmbeddingEngines/azureOpenAi/index.js (+3 -3)
📝 server/utils/EmbeddingEngines/localAi/index.js (+4 -4)
📝 server/utils/EmbeddingEngines/native/index.js (+4 -3)
📝 server/utils/EmbeddingEngines/openAi/index.js (+4 -4)
📝 server/utils/helpers/index.js (+15 -0)
📝 server/utils/helpers/updateENV.js (+4 -0)
📝 server/utils/vectorDbProviders/chroma/index.js (+7 -2)
📝 server/utils/vectorDbProviders/lance/index.js (+7 -2)
📝 server/utils/vectorDbProviders/pinecone/index.js (+7 -2)
📝 server/utils/vectorDbProviders/qdrant/index.js (+7 -2)
📝 server/utils/vectorDbProviders/weaviate/index.js (+7 -2)

📄 Description

fix: cleanup code for embedding length clarify
resolves #388


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/Mintplex-Labs/anything-llm/pull/415 **Author:** [@timothycarambat](https://github.com/timothycarambat) **Created:** 12/7/2023 **Status:** ✅ Merged **Merged:** 12/7/2023 **Merged by:** [@timothycarambat](https://github.com/timothycarambat) **Base:** `master` ← **Head:** `388-embedding-max-token-size` --- ### 📝 Commits (1) - [`2eb1e73`](https://github.com/Mintplex-Labs/anything-llm/commit/2eb1e7326fe29db732210ac1c112e7d0dcf70ac4) feat: add support for variable chunk length ### 📊 Changes **15 files changed** (+89 additions, -24 deletions) <details> <summary>View changed files</summary> 📝 `docker/.env.example` (+1 -0) 📝 `frontend/src/components/EmbeddingSelection/LocalAiOptions/index.jsx` (+16 -0) 📝 `server/.env.example` (+1 -0) 📝 `server/models/systemSettings.js` (+2 -0) 📝 `server/utils/EmbeddingEngines/azureOpenAi/index.js` (+3 -3) 📝 `server/utils/EmbeddingEngines/localAi/index.js` (+4 -4) 📝 `server/utils/EmbeddingEngines/native/index.js` (+4 -3) 📝 `server/utils/EmbeddingEngines/openAi/index.js` (+4 -4) 📝 `server/utils/helpers/index.js` (+15 -0) 📝 `server/utils/helpers/updateENV.js` (+4 -0) 📝 `server/utils/vectorDbProviders/chroma/index.js` (+7 -2) 📝 `server/utils/vectorDbProviders/lance/index.js` (+7 -2) 📝 `server/utils/vectorDbProviders/pinecone/index.js` (+7 -2) 📝 `server/utils/vectorDbProviders/qdrant/index.js` (+7 -2) 📝 `server/utils/vectorDbProviders/weaviate/index.js` (+7 -2) </details> ### 📄 Description fix: cleanup code for embedding length clarify resolves #388 --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-22 18:33:36 -05:00
yindo closed this issue 2026-02-22 18:33:36 -05:00
yindo changed title from [PR #415] feat: add support for variable chunk length to [PR #415] [MERGED] feat: add support for variable chunk length 2026-06-05 15:12:56 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#3348