dify rerank question #17328

Closed
opened 2026-02-21 19:34:05 -05:00 by yindo · 0 comments
Owner

Originally created by @Char-CN on GitHub (Sep 13, 2025).

Self Checks

  • I have read the Contributing Guide and Language Policy.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report, otherwise it will be closed.
  • Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

I'd like to ask about Dify's reranking, which uses the TD-IDF algorithm and vector-based scoring. However, I see a note that says "Calculate BM25 scores," but it actually uses TD-IDF + Vector scores. Why isn't the BM25 score calculated here? Is it because normalization isn't possible?

Image

2. Additional context or comments

No response

3. Can you help us with this feature?

  • I am interested in contributing to this feature.
Originally created by @Char-CN on GitHub (Sep 13, 2025). ### Self Checks - [x] I have read the [Contributing Guide](https://github.com/langgenius/dify/blob/main/CONTRIBUTING.md) and [Language Policy](https://github.com/langgenius/dify/issues/1542). - [x] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [x] I confirm that I am using English to submit this report, otherwise it will be closed. - [x] Please do not modify this template :) and fill in all the required fields. ### 1. Is this request related to a challenge you're experiencing? Tell me about your story. I'd like to ask about Dify's reranking, which uses the TD-IDF algorithm and vector-based scoring. However, I see a note that says "Calculate BM25 scores," but it actually uses TD-IDF + Vector scores. Why isn't the BM25 score calculated here? Is it because normalization isn't possible? <img width="724" height="376" alt="Image" src="https://github.com/user-attachments/assets/0934cd1c-b483-46fe-b56e-95e3eefb7337" /> ### 2. Additional context or comments _No response_ ### 3. Can you help us with this feature? - [x] I am interested in contributing to this feature.
yindo added the 🙋‍♂️ question label 2026-02-21 19:34:05 -05:00
yindo closed this issue 2026-02-21 19:34:05 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#17328