Chatflow Agent streaming output #645

Closed
opened 2026-02-16 10:20:02 -05:00 by yindo · 1 comment
Owner

Originally created by @zt89974292 on GitHub (Sep 12, 2025).

Self Checks

  • I have read the Contributing Guide and Language Policy.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report, otherwise it will be closed.
  • Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

At present, Chatflow Agent is unable to stream output, but only outputs all the content at once. The experience is not very good. If it is a problem with my configuration or usage posture, please advise. If this is currently the only way, I hope it can be optimized in the future

2. Additional context or comments

No response

3. Can you help us with this feature?

  • I am interested in contributing to this feature.
Originally created by @zt89974292 on GitHub (Sep 12, 2025). ### Self Checks - [x] I have read the [Contributing Guide](https://github.com/langgenius/dify/blob/main/CONTRIBUTING.md) and [Language Policy](https://github.com/langgenius/dify/issues/1542). - [x] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify-official-plugins/issues), including closed ones. - [x] I confirm that I am using English to submit this report, otherwise it will be closed. - [x] Please do not modify this template :) and fill in all the required fields. ### 1. Is this request related to a challenge you're experiencing? Tell me about your story. At present, Chatflow Agent is unable to stream output, but only outputs all the content at once. The experience is not very good. If it is a problem with my configuration or usage posture, please advise. If this is currently the only way, I hope it can be optimized in the future ### 2. Additional context or comments _No response_ ### 3. Can you help us with this feature? - [ ] I am interested in contributing to this feature.
yindo added the enhancement label 2026-02-16 10:20:02 -05:00
yindo closed this issue 2026-02-16 10:20:02 -05:00
Author
Owner

@dosubot[bot] commented on GitHub (Sep 12, 2025):

Currently, Chatflow Agent nodes using the plug-in policy in Dify do not support streaming output—they return the entire response at once, regardless of configuration. This is a known limitation due to how tool-based requests are handled, and setting stream=True does not enable streaming in this context. However, streaming output support for agent nodes is planned via the upcoming "stream-tool-call" feature, targeted for Dify version 1.1.4 and later details.

When streaming becomes available, it will have some limitations: ReAct mode will not support streaming (only Function Calling mode will), and some model plugins (like Ollama) will not support the feature. For best results, use official Tongyi models (e.g., Qwen-max) and select Function Calling mode in the Agent strategies settings reference.

There are also some known architectural issues in chatflows (such as with multiple conditional nodes) that can prevent streaming, but workarounds exist and improvements are in progress see here.

To reply, just mention @dosu.


How did I do? Good | Irrelevant | Incorrect | Verbose | Hallucination | Report 🐛 | Other  Join Discord Share on X

@dosubot[bot] commented on GitHub (Sep 12, 2025): <!-- Answer --> Currently, Chatflow Agent nodes using the plug-in policy in Dify do not support streaming output—they return the entire response at once, regardless of configuration. This is a known limitation due to how tool-based requests are handled, and setting `stream=True` does not enable streaming in this context. However, streaming output support for agent nodes is planned via the upcoming "stream-tool-call" feature, targeted for Dify version 1.1.4 and later [details](https://github.com/langgenius/dify/issues/17615). When streaming becomes available, it will have some limitations: ReAct mode will not support streaming (only Function Calling mode will), and some model plugins (like Ollama) will not support the feature. For best results, use official Tongyi models (e.g., Qwen-max) and select Function Calling mode in the Agent strategies settings [reference](https://github.com/langgenius/dify/issues/20952). There are also some known architectural issues in chatflows (such as with multiple conditional nodes) that can prevent streaming, but workarounds exist and improvements are in progress [see here](https://github.com/langgenius/dify/issues/23469). <!-- Dosu Comment Footer --> *To reply, just mention [@dosu](https://go.dosu.dev/dosubot).* --- <sup>How did I do? [Good](https://app.dosu.dev/response-feedback/e942ee75-a4fa-4fcb-8334-632f9356ebfe?feedback_type=great_response) | [Irrelevant](https://app.dosu.dev/response-feedback/e942ee75-a4fa-4fcb-8334-632f9356ebfe?feedback_type=irrelevant_answer) | [Incorrect](https://app.dosu.dev/response-feedback/e942ee75-a4fa-4fcb-8334-632f9356ebfe?feedback_type=incorrect_sources) | [Verbose](https://app.dosu.dev/response-feedback/e942ee75-a4fa-4fcb-8334-632f9356ebfe?feedback_type=too_verbose) | [Hallucination](https://app.dosu.dev/response-feedback/e942ee75-a4fa-4fcb-8334-632f9356ebfe?feedback_type=hallucination) | [Report 🐛](https://app.dosu.dev/response-feedback/e942ee75-a4fa-4fcb-8334-632f9356ebfe?feedback_type=bug_report) | [Other](https://app.dosu.dev/response-feedback/e942ee75-a4fa-4fcb-8334-632f9356ebfe?feedback_type=other)</sup>&nbsp;&nbsp;[![Join Discord](https://img.shields.io/badge/join-5865F2?logo=discord&logoColor=white&label=)](https://go.dosu.dev/discord-bot)&nbsp;[![Share on X](https://img.shields.io/badge/X-share-black)](https://twitter.com/intent/tweet?text=%40dosu_ai%20helped%20me%20solve%20this%20issue!&url=https%3A//github.com/langgenius/dify-official-plugins/issues/1703)
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify-official-plugins#645