GUI for monitoring and view progress of task #5536

Closed
opened 2026-02-21 18:11:30 -05:00 by yindo · 2 comments
Owner

Originally created by @nhha1602 on GitHub (Sep 11, 2024).

Self Checks

  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

Do we support a GUI that we can see the progress of task processing or monitor of task processing on worker ? It is helpful for the task that take time to handle when we use API to add file for a Knowledge ...

2. Additional context or comments

No response

3. Can you help us with this feature?

  • I am interested in contributing to this feature.
Originally created by @nhha1602 on GitHub (Sep 11, 2024). ### Self Checks - [X] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [X] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [X] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:) - [X] Please do not modify this template :) and fill in all the required fields. ### 1. Is this request related to a challenge you're experiencing? Tell me about your story. Do we support a GUI that we can see the progress of task processing or monitor of task processing on worker ? It is helpful for the task that take time to handle when we use API to add file for a Knowledge ... ### 2. Additional context or comments _No response_ ### 3. Can you help us with this feature? - [ ] I am interested in contributing to this feature.
yindo added the 💪 enhancement label 2026-02-21 18:11:30 -05:00
yindo closed this issue 2026-02-21 18:11:30 -05:00
Author
Owner

@dosubot[bot] commented on GitHub (Sep 11, 2024):

I found a similar unsolved discussion: UX Chat Page UI: Add visibility of response status for each chat at the chatpage level [1].

Regarding your question, the Dify platform does have built-in monitoring tools and interfaces for tracking task progress. It includes "observability features" and "LLMOps" which allow you to monitor and analyze application logs and performance over time. Additionally, Dify can be integrated with external Ops tools like LangSmith and Langfuse to provide comprehensive tracking and deep evaluation capabilities throughout the application lifecycle, from prototyping to production [2][3][4][5].

For task status or progress information, Dify provides an API endpoint to get the document embedding status (progress):

curl --location --request GET 'https://api.dify.ai/v1/datasets/{dataset_id}/documents/{batch}/indexing-status' \
--header 'Authorization: Bearer {api_key}'

Additionally, Dify offers a comprehensive set of dataset management APIs that allow you to create, list, and manage datasets and documents, as well as retrieve their statuses [6][7].

For long-running tasks, Dify handles and monitors them through real-time monitoring of performance data, ensuring stable operation of applications and providing complete log records [5].

There is also existing documentation and code related to task management and monitoring in the Dify codebase. The documentation mentions the Worker Asynchronous Queue Consumption Service and provides commands to start the Worker service for consuming asynchronous tasks from the queue [8][9][2][10].

Lastly, Dify recommends integrating with third-party LLMOps tools like LangSmith and Langfuse for monitoring and tracking task progress. These tools provide comprehensive tracking and deep evaluation capabilities for LLM applications [3][11].

To continue talking to Dosu, mention @dosu.

@dosubot[bot] commented on GitHub (Sep 11, 2024): <!-- Answer --> I found a similar unsolved discussion: [UX Chat Page UI: Add visibility of response status for each chat at the chatpage level](https://github.com/langgenius/dify/discussions/4719) <sup>[[1]](https://github.com/langgenius/dify/discussions/4719)</sup>. Regarding your question, the Dify platform does have built-in monitoring tools and interfaces for tracking task progress. It includes "observability features" and "LLMOps" which allow you to monitor and analyze application logs and performance over time. Additionally, Dify can be integrated with external Ops tools like LangSmith and Langfuse to provide comprehensive tracking and deep evaluation capabilities throughout the application lifecycle, from prototyping to production <sup>[[2]](https://github.com/langgenius/dify/blob/main/README.md)</sup><sup>[[3]](https://github.com/langgenius/dify-docs/blob/main/en/guides/monitoring/integrate-external-ops-tools/README.md)</sup><sup>[[4]](https://github.com/langgenius/dify/blob/main/README_KL.md)</sup><sup>[[5]](https://github.com/langgenius/dify-docs/blob/main/en/learn-more/extended-reading/what-is-llmops.md)</sup>. For task status or progress information, Dify provides an API endpoint to get the document embedding status (progress): ```bash curl --location --request GET 'https://api.dify.ai/v1/datasets/{dataset_id}/documents/{batch}/indexing-status' \ --header 'Authorization: Bearer {api_key}' ``` Additionally, Dify offers a comprehensive set of dataset management APIs that allow you to create, list, and manage datasets and documents, as well as retrieve their statuses <sup>[[6]](https://github.com/langgenius/dify-docs/blob/main/en/guides/knowledge-base/maintain-dataset-via-api.md)</sup><sup>[[7]](https://github.com/langgenius/dify-docs/blob/main/jp/guides/knowledge-base/maintain-dataset-via-api.md)</sup>. For long-running tasks, Dify handles and monitors them through real-time monitoring of performance data, ensuring stable operation of applications and providing complete log records <sup>[[5]](https://github.com/langgenius/dify-docs/blob/main/en/learn-more/extended-reading/what-is-llmops.md)</sup>. There is also existing documentation and code related to task management and monitoring in the Dify codebase. The documentation mentions the Worker Asynchronous Queue Consumption Service and provides commands to start the Worker service for consuming asynchronous tasks from the queue <sup>[[8]](https://github.com/langgenius/dify-docs/blob/main/en/getting-started/install-self-hosted/local-source-code.md)</sup><sup>[[9]](https://github.com/langgenius/dify-docs/blob/main/zh_CN/getting-started/install-self-hosted/local-source-code.md)</sup><sup>[[2]](https://github.com/langgenius/dify/blob/main/README.md)</sup><sup>[[10]](https://github.com/langgenius/dify-docs/blob/main/jp/getting-started/install-self-hosted/local-source-code.md)</sup>. Lastly, Dify recommends integrating with third-party LLMOps tools like LangSmith and Langfuse for monitoring and tracking task progress. These tools provide comprehensive tracking and deep evaluation capabilities for LLM applications <sup>[[3]](https://github.com/langgenius/dify-docs/blob/main/en/guides/monitoring/integrate-external-ops-tools/README.md)</sup><sup>[[11]](https://github.com/langgenius/dify-docs/blob/main/en/guides/monitoring/integrate-external-ops-tools/integrate-langsmith.md)</sup>. <!-- Dosu Comment Footer --> *To continue talking to [Dosu](https://dosu.dev), mention @dosu.*
Author
Owner

@crazywoola commented on GitHub (Sep 11, 2024):

I don't think it's a feature request to Dify itself. Try this one. https://github.com/mher/flower

@crazywoola commented on GitHub (Sep 11, 2024): I don't think it's a feature request to Dify itself. Try this one. https://github.com/mher/flower
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#5536