Qdrant does not support full-text search for numbers or letters #5170

Closed
opened 2026-02-21 18:09:43 -05:00 by yindo · 2 comments
Owner

Originally created by @leoterry-ulrica on GitHub (Aug 22, 2024).

Originally assigned to: @JohnJyong on GitHub.

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

Dify version

0.7.0

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

  1. Recall Test,select full text search
  2. input numbers or letters,forexample:3+;or:3;or:X
  3. click test, return empty data

✔️ Expected Behavior

image

Actual Behavior

image

Originally created by @leoterry-ulrica on GitHub (Aug 22, 2024). Originally assigned to: @JohnJyong on GitHub. ### Self Checks - [X] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [X] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [X] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [X] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:) - [X] Please do not modify this template :) and fill in all the required fields. ### Dify version 0.7.0 ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce 1. Recall Test,select full text search 2. input numbers or letters,forexample:3+;or:3;or:X 3. click test, return empty data ### ✔️ Expected Behavior ![image](https://github.com/user-attachments/assets/12539ca6-6e20-46e1-ba64-47c2c9cedc2d) ### ❌ Actual Behavior ![image](https://github.com/user-attachments/assets/b95ab899-8a57-4c46-9ff3-837044e68734)
yindo added the 👻 feat:rag label 2026-02-21 18:09:43 -05:00
yindo closed this issue 2026-02-21 18:09:43 -05:00
Author
Owner

@dosubot[bot] commented on GitHub (Aug 22, 2024):

The issue you're encountering is due to a known limitation in Dify's integration with Qdrant. Specifically, Qdrant does not support full-text search for numbers or letters. This limitation is documented in the Dify repository, where it is noted that "milvus/zilliz/relyt doesn't support bm25 search" [1].

To address this, you might consider using alternative indexing and retrieval strategies provided by Dify, such as vector search or hybrid search, which may offer better support for your use case. Additionally, you can adjust parameters like TopK and Score Threshold to fine-tune the retrieval process [2][3].

To continue talking to Dosu, mention @dosu.

@dosubot[bot] commented on GitHub (Aug 22, 2024): <!-- Answer --> The issue you're encountering is due to a known limitation in Dify's integration with Qdrant. Specifically, Qdrant does not support full-text search for numbers or letters. This limitation is documented in the Dify repository, where it is noted that "milvus/zilliz/relyt doesn't support bm25 search" <sup>[[1]](https://github.com/langgenius/dify/blob/main/api/core/rag/datasource/vdb/relyt/relyt_vector.py)</sup>. To address this, you might consider using alternative indexing and retrieval strategies provided by Dify, such as vector search or hybrid search, which may offer better support for your use case. Additionally, you can adjust parameters like TopK and Score Threshold to fine-tune the retrieval process <sup>[[2]](https://github.com/langgenius/dify-docs/blob/main/en/guides/knowledge-base/create-knowledge-and-upload-documents.md)</sup><sup>[[3]](https://github.com/langgenius/dify/blob/main/api/core/rag/datasource/vdb/qdrant/qdrant_vector.py)</sup>. <!-- Dosu Comment Footer --> *To continue talking to [Dosu](https://dosu.dev), mention @dosu.*
Author
Owner

@JohnJyong commented on GitHub (Aug 22, 2024):

Word segmentation rule restrictions cannot be met for the time being.

@JohnJyong commented on GitHub (Aug 22, 2024): Word segmentation rule restrictions cannot be met for the time being.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#5170