[PR #4438] [CLOSED] Enable reranking for all vector dbs #4622

Closed
opened 2026-02-22 18:36:12 -05:00 by yindo · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/Mintplex-Labs/anything-llm/pull/4438
Author: @shatfield4
Created: 9/25/2025
Status: Closed

Base: masterHead: 3941-feat-enable-reranking-models-with-vector-dbs-other-than-lancedb


📝 Commits (10+)

  • 2e6a431 wip support reranker for all vector dbs
  • 9b717b2 simplify rerank.js + fix chroma/lance db reranking
  • 72e1aec fix scores + reranking for milvus, zilliz, astra providers
  • 824dba8 Merge branch 'master' into 3941-feat-enable-reranking-models-with-vector-dbs-other-than-lancedb
  • 0f227ce pgvector reranking support
  • bbfc7b9 support reranking for pinecone, qdrant, weaviate providers
  • 6e47ad8 unneeded console log
  • b03ec4c refactor structure to prep for other external embedding rerankers
  • d459da9 Merge branch 'master' into 3941-feat-enable-reranking-models-with-vector-dbs-other-than-lancedb
  • f10ecef Merge branch 'master' into 3941-feat-enable-reranking-models-with-vector-dbs-other-than-lancedb

📊 Changes

12 files changed (+664 additions, -191 deletions)

View changed files

📝 frontend/src/pages/WorkspaceSettings/VectorDatabase/VectorSearchMode/index.jsx (+1 -5)
server/utils/EmbeddingRerankers/rerank.js (+29 -0)
📝 server/utils/helpers/index.js (+29 -0)
📝 server/utils/vectorDbProviders/astra/index.js (+70 -15)
📝 server/utils/vectorDbProviders/chroma/index.js (+68 -10)
📝 server/utils/vectorDbProviders/lance/index.js (+29 -53)
📝 server/utils/vectorDbProviders/milvus/index.js (+61 -8)
📝 server/utils/vectorDbProviders/pgvector/index.js (+85 -30)
📝 server/utils/vectorDbProviders/pinecone/index.js (+61 -8)
📝 server/utils/vectorDbProviders/qdrant/index.js (+67 -14)
📝 server/utils/vectorDbProviders/weaviate/index.js (+71 -17)
📝 server/utils/vectorDbProviders/zilliz/index.js (+93 -31)

📄 Description

Pull Request Type

  • feat
  • 🐛 fix
  • ♻️ refactor
  • 💄 style
  • 🔨 chore
  • 📝 docs

Relevant Issues

resolves #3941

What is in this change?

  • Adds support for NativeEmbeddingReranker on all vector db providers
  • Sets up structure to support many other embedding reranker providers

Additional Information

  • Astra
  • Chroma
  • Chroma Cloud
  • LanceDB
  • Milvus
  • PGVector
  • Pinecone
  • Qdrant
  • Weaviate
  • Zilliz

Developer Validations

  • I ran yarn lint from the root of the repo & committed changes
  • Relevant documentation has been updated
  • I have tested my code functionality
  • Docker build succeeds locally

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/Mintplex-Labs/anything-llm/pull/4438 **Author:** [@shatfield4](https://github.com/shatfield4) **Created:** 9/25/2025 **Status:** ❌ Closed **Base:** `master` ← **Head:** `3941-feat-enable-reranking-models-with-vector-dbs-other-than-lancedb` --- ### 📝 Commits (10+) - [`2e6a431`](https://github.com/Mintplex-Labs/anything-llm/commit/2e6a4313dd4750a62748ed217df27d470b74fccc) wip support reranker for all vector dbs - [`9b717b2`](https://github.com/Mintplex-Labs/anything-llm/commit/9b717b2fc64e02f04bc6098da0f33d4c6df0659f) simplify rerank.js + fix chroma/lance db reranking - [`72e1aec`](https://github.com/Mintplex-Labs/anything-llm/commit/72e1aec0f17f9d18c650044a00e4046260d11caa) fix scores + reranking for milvus, zilliz, astra providers - [`824dba8`](https://github.com/Mintplex-Labs/anything-llm/commit/824dba8c6d18ffd5fff6a3b9d385715264740b95) Merge branch 'master' into 3941-feat-enable-reranking-models-with-vector-dbs-other-than-lancedb - [`0f227ce`](https://github.com/Mintplex-Labs/anything-llm/commit/0f227ce283800bf5d4803fd0512f1db7d93df8a8) pgvector reranking support - [`bbfc7b9`](https://github.com/Mintplex-Labs/anything-llm/commit/bbfc7b965c204164da27741e3090a239c64d4134) support reranking for pinecone, qdrant, weaviate providers - [`6e47ad8`](https://github.com/Mintplex-Labs/anything-llm/commit/6e47ad8378ff1c548d1acc0da6e7cf02467d050c) unneeded console log - [`b03ec4c`](https://github.com/Mintplex-Labs/anything-llm/commit/b03ec4cd6237dce36caa3aae79da533ef2d28d76) refactor structure to prep for other external embedding rerankers - [`d459da9`](https://github.com/Mintplex-Labs/anything-llm/commit/d459da9856ae799b66a6afd92e86de240bbfae0a) Merge branch 'master' into 3941-feat-enable-reranking-models-with-vector-dbs-other-than-lancedb - [`f10ecef`](https://github.com/Mintplex-Labs/anything-llm/commit/f10ecef5af9672de26ebb6e425450aa6fa0e4c68) Merge branch 'master' into 3941-feat-enable-reranking-models-with-vector-dbs-other-than-lancedb ### 📊 Changes **12 files changed** (+664 additions, -191 deletions) <details> <summary>View changed files</summary> 📝 `frontend/src/pages/WorkspaceSettings/VectorDatabase/VectorSearchMode/index.jsx` (+1 -5) ➕ `server/utils/EmbeddingRerankers/rerank.js` (+29 -0) 📝 `server/utils/helpers/index.js` (+29 -0) 📝 `server/utils/vectorDbProviders/astra/index.js` (+70 -15) 📝 `server/utils/vectorDbProviders/chroma/index.js` (+68 -10) 📝 `server/utils/vectorDbProviders/lance/index.js` (+29 -53) 📝 `server/utils/vectorDbProviders/milvus/index.js` (+61 -8) 📝 `server/utils/vectorDbProviders/pgvector/index.js` (+85 -30) 📝 `server/utils/vectorDbProviders/pinecone/index.js` (+61 -8) 📝 `server/utils/vectorDbProviders/qdrant/index.js` (+67 -14) 📝 `server/utils/vectorDbProviders/weaviate/index.js` (+71 -17) 📝 `server/utils/vectorDbProviders/zilliz/index.js` (+93 -31) </details> ### 📄 Description ### Pull Request Type <!-- For change type, change [ ] to [x]. --> - [x] ✨ feat - [ ] 🐛 fix - [ ] ♻️ refactor - [ ] 💄 style - [ ] 🔨 chore - [ ] 📝 docs ### Relevant Issues <!-- Use "resolves #xxx" to auto resolve on merge. Otherwise, please use "connect #xxx" --> resolves #3941 ### What is in this change? <!-- Describe the changes in this PR that are impactful to the repo. --> - Adds support for `NativeEmbeddingReranker` on all vector db providers - Sets up structure to support many other embedding reranker providers ### Additional Information <!-- Add any other context about the Pull Request here that was not captured above. --> - [x] Astra - [x] Chroma - [x] Chroma Cloud - [x] LanceDB - [x] Milvus - [x] PGVector - [x] Pinecone - [x] Qdrant - [x] Weaviate - [x] Zilliz ### Developer Validations <!-- All of the applicable items should be checked. --> - [x] I ran `yarn lint` from the root of the repo & committed changes - [x] Relevant documentation has been updated - [x] I have tested my code functionality - [x] Docker build succeeds locally --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-22 18:36:12 -05:00
yindo closed this issue 2026-02-22 18:36:12 -05:00
yindo changed title from [PR #4438] Enable reranking for all vector dbs to [PR #4438] [CLOSED] Enable reranking for all vector dbs 2026-06-05 15:19:30 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#4622