Issues with Document Character Count and Recall Frequency Statistics #6417

Closed
opened 2026-02-21 18:15:38 -05:00 by yindo · 2 comments
Owner

Originally created by @NoobHaoZi on GitHub (Oct 29, 2024).

Originally assigned to: @JohnJyong on GitHub.

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

Dify version

0.9.1

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

After the knowledge base completes indexing, modify the original segmented content or add new segments.

The character count of the document will not be updated.

Additionally, if the new segmented content passes the recall test or matches through knowledge base retrieval, it will not count towards the recall frequency.
企业微信截图_17301946715130

✔️ Expected Behavior

Expected Results:

1 When new segments are added or existing segments are modified, the document's character count updates accordingly.
2 When the knowledge base retrieval hits newly added segments, the recall frequency is recorded accurately.

Actual Behavior

Actual Results:

1 When new segments are added or existing segments are modified, the document's character count does not update accordingly.
2 When the knowledge base retrieval hits newly added segments, the recall frequency is not recorded.

Originally created by @NoobHaoZi on GitHub (Oct 29, 2024). Originally assigned to: @JohnJyong on GitHub. ### Self Checks - [X] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [X] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [X] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [X] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:) - [X] Please do not modify this template :) and fill in all the required fields. ### Dify version 0.9.1 ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce After the knowledge base completes indexing, modify the original segmented content or add new segments. The character count of the document will not be updated. Additionally, if the new segmented content passes the recall test or matches through knowledge base retrieval, it will not count towards the recall frequency. ![企业微信截图_17301946715130](https://github.com/user-attachments/assets/fc81d8b9-06b4-40fb-9dbd-c43d16d065e8) ### ✔️ Expected Behavior Expected Results: 1 When new segments are added or existing segments are modified, the document's character count updates accordingly. 2 When the knowledge base retrieval hits newly added segments, the recall frequency is recorded accurately. ### ❌ Actual Behavior Actual Results: 1 When new segments are added or existing segments are modified, the document's character count does not update accordingly. 2 When the knowledge base retrieval hits newly added segments, the recall frequency is not recorded.
yindo added the 🐞 bug label 2026-02-21 18:15:38 -05:00
yindo closed this issue 2026-02-21 18:15:38 -05:00
Author
Owner

@dosubot[bot] commented on GitHub (Oct 29, 2024):

Hello @NoobHaoZi! I'm here to help you with any bugs, questions, or contributions you have for Dify. Let's work together to resolve this issue!

The issue you're experiencing with Dify version 0.9.1, where the document's character count and recall frequency statistics are not updating after modifying or adding new segments, seems to be a bug. Unfortunately, I couldn't find specific information on how Dify handles updates to document character counts or recall frequency in the current documentation or codebase.

However, the expected behavior should involve automatic updates to both the character count and recall frequency when segments are modified or added. This ensures that the knowledge base remains accurate and reflective of the current data.

For now, you might want to check if there are any updates or patches available for Dify that address this issue, or consider reaching out to the maintainers for further assistance.

To continue talking to Dosu, mention @dosu.

@dosubot[bot] commented on GitHub (Oct 29, 2024): <!-- Greeting --> Hello @NoobHaoZi! I'm here to help you with any bugs, questions, or contributions you have for Dify. Let's work together to resolve this issue! <!-- Answer --> The issue you're experiencing with Dify version 0.9.1, where the document's character count and recall frequency statistics are not updating after modifying or adding new segments, seems to be a bug. Unfortunately, I couldn't find specific information on how Dify handles updates to document character counts or recall frequency in the current documentation or codebase. However, the expected behavior should involve automatic updates to both the character count and recall frequency when segments are modified or added. This ensures that the knowledge base remains accurate and reflective of the current data. For now, you might want to check if there are any updates or patches available for Dify that address this issue, or consider reaching out to the maintainers for further assistance. <!-- Dosu Comment Footer --> *To continue talking to [Dosu](https://dosu.dev), mention @dosu.*
Author
Owner

@JohnJyong commented on GitHub (Oct 31, 2024):

  1. the document word count will be fixed later
  2. for retrieval count, it only be counted when you retrieve it in the chatbot or workflow, retrieve-testing will not be included.
    @NoobHaoZi
@JohnJyong commented on GitHub (Oct 31, 2024): 1. the document word count will be fixed later 2. for retrieval count, it only be counted when you retrieve it in the chatbot or workflow, retrieve-testing will not be included. @NoobHaoZi
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#6417