The reranking model has been set up successfully, but it is not taking effect and the original model is still being used. #6585

Closed
opened 2026-02-21 18:16:25 -05:00 by yindo · 3 comments
Owner

Originally created by @zhukefucn on GitHub (Nov 5, 2024).

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

Dify version

0.10.0

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

The reranking model has been set up successfully, but it is not taking effect and the original model is still being used.
original model is jina,I changed to cohere model , set in two position , one is default rerank model setting , the other is in knowledge base .

✔️ Expected Behavior

new rerank model setting taking effect correctly

Actual Behavior

The reranking model has been set up successfully, but it is not taking effect and the original model is still being used.

Originally created by @zhukefucn on GitHub (Nov 5, 2024). ### Self Checks - [X] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [X] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [X] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [X] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:) - [X] Please do not modify this template :) and fill in all the required fields. ### Dify version 0.10.0 ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce The reranking model has been set up successfully, but it is not taking effect and the original model is still being used. original model is jina,I changed to cohere model , set in two position , one is default rerank model setting , the other is in knowledge base . ### ✔️ Expected Behavior new rerank model setting taking effect correctly ### ❌ Actual Behavior The reranking model has been set up successfully, but it is not taking effect and the original model is still being used.
yindo closed this issue 2026-02-21 18:16:25 -05:00
Author
Owner

@dosubot[bot] commented on GitHub (Nov 5, 2024):

I found some similar issues that might help you troubleshoot the problem:

  1. Knowledge Retrieval Node Incorrectly Reverts to RerankModel: This issue was resolved by ensuring the reranking configuration is preserved correctly. You might want to check if your configuration is being overridden or not saved properly [1].

  2. How to use Xinference's rerank models in Dify?: This issue was resolved by validating the model UID. Ensure that the model configuration, including any identifiers, is correctly set up [2].

  3. 用了Cohere的rerank API,对话没有产生回放: This issue highlighted several potential causes for reranking not taking effect, such as an empty document list, score thresholds not being met, invalid API keys, or connection errors. Check these aspects to ensure they are not causing the issue [3].

For your specific case, ensure that the reranking model settings are correctly configured in both the default settings and the knowledge base settings. Verify that the reranking_mode and reranking_model configurations are correct and that there are no authorization errors or misconfigurations in the Docker setup. Additionally, check the logs for any errors or warnings that might indicate why the new model is not being applied.

To continue talking to Dosu, mention @dosu.

@dosubot[bot] commented on GitHub (Nov 5, 2024): <!-- Answer --> I found some similar issues that might help you troubleshoot the problem: 1. **Knowledge Retrieval Node Incorrectly Reverts to RerankModel**: This issue was resolved by ensuring the reranking configuration is preserved correctly. You might want to check if your configuration is being overridden or not saved properly <sup>[[1]](https://github.com/langgenius/dify/issues/8854)</sup>. 2. **How to use Xinference's rerank models in Dify?**: This issue was resolved by validating the model UID. Ensure that the model configuration, including any identifiers, is correctly set up <sup>[[2]](https://github.com/langgenius/dify/issues/2457)</sup>. 3. **用了Cohere的rerank API,对话没有产生回放**: This issue highlighted several potential causes for reranking not taking effect, such as an empty document list, score thresholds not being met, invalid API keys, or connection errors. Check these aspects to ensure they are not causing the issue <sup>[[3]](https://github.com/langgenius/dify/issues/2021)</sup>. For your specific case, ensure that the reranking model settings are correctly configured in both the default settings and the knowledge base settings. Verify that the `reranking_mode` and `reranking_model` configurations are correct and that there are no authorization errors or misconfigurations in the Docker setup. Additionally, check the logs for any errors or warnings that might indicate why the new model is not being applied. <!-- Dosu Comment Footer --> *To continue talking to [Dosu](https://dosu.dev), mention @dosu.*
Author
Owner

@crazywoola commented on GitHub (Nov 5, 2024):

This has been fixed in later version, please upgrade to latest one.

@crazywoola commented on GitHub (Nov 5, 2024): This has been fixed in later version, please upgrade to latest one.
Author
Owner

@zhukefucn commented on GitHub (Nov 5, 2024):

How can I change data setting to slove the problem temporerly ?

@zhukefucn commented on GitHub (Nov 5, 2024): How can I change data setting to slove the problem temporerly ?
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#6585