Can not stream out after using variable aggregator #12046

Closed
opened 2026-02-21 19:05:28 -05:00 by yindo · 2 comments
Owner

Originally created by @moccanism on GitHub (Mar 24, 2025).

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

Dify version

1.1.2

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

My process is quite simple: user input is classified into two branches by a classifier, each goes into a different LLM node. The outputs from the LLMs are then aggregated by a variable aggregator, resulting by the final answer node.

Image

✔️ Expected Behavior

The output should be streamed out, even with a variable aggregator

Actual Behavior

In my flow, the final result is not streamed but is blocked at LLM nodes to response.

Originally created by @moccanism on GitHub (Mar 24, 2025). ### Self Checks - [x] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [x] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [x] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:) - [x] Please do not modify this template :) and fill in all the required fields. ### Dify version 1.1.2 ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce My process is quite simple: user input is classified into two branches by a classifier, each goes into a different LLM node. The outputs from the LLMs are then aggregated by a variable aggregator, resulting by the final answer node. ![Image](https://github.com/user-attachments/assets/eb937146-f7d9-45b8-a463-c6febf43c040) ### ✔️ Expected Behavior The output should be streamed out, even with a variable aggregator ### ❌ Actual Behavior In my flow, the final result is not streamed but is blocked at LLM nodes to response.
yindo closed this issue 2026-02-21 19:05:28 -05:00
Author
Owner

@dosubot[bot] commented on GitHub (Mar 24, 2025):

@moccanism Hello there! I'm here to help you with bugs, questions, and more while you wait for a human maintainer. Let's take a look at the issue you're experiencing.

I found some relevant information that might help with your issue regarding streaming output when using a variable aggregator in Dify.

  1. There is a known issue with streaming output in Dify version 1.1.2, where the process might not provide a streaming response due to the exception handling setting. Disabling the exception handling ('异常处理') in your workflow configuration might resolve the issue [1].

  2. To ensure proper streaming output when using a variable aggregator, you should:

    • Create two separate parallel branches for your workflow.
    • Use a variable aggregator to converge these branches before connecting to the LLM block.
    • Remove any unused exception branch handlers, as they can interfere with streaming output [2][3].

These steps should help maintain proper streaming output in your Dify workflow.

To continue talking to Dosu, mention @dosu.


Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Bug Report | Other

@dosubot[bot] commented on GitHub (Mar 24, 2025): <!-- Greeting --> @moccanism Hello there! I'm here to help you with bugs, questions, and more while you wait for a human maintainer. Let's take a look at the issue you're experiencing. <!-- Answer --> I found some relevant information that might help with your issue regarding streaming output when using a variable aggregator in Dify. 1. There is a known issue with streaming output in Dify version 1.1.2, where the process might not provide a streaming response due to the exception handling setting. Disabling the exception handling ('异常处理') in your workflow configuration might resolve the issue <sup>[[1]](https://github.com/langgenius/dify/issues/15458)</sup>. 2. To ensure proper streaming output when using a variable aggregator, you should: - Create two separate parallel branches for your workflow. - Use a variable aggregator to converge these branches before connecting to the LLM block. - Remove any unused exception branch handlers, as they can interfere with streaming output <sup>[[2]](https://github.com/langgenius/dify/issues/15351)</sup><sup>[[3]](https://github.com/langgenius/dify/issues/15162)</sup>. These steps should help maintain proper streaming output in your Dify workflow. <!-- Dosu Comment Footer --> *To continue talking to [Dosu](https://dosu.dev), mention @dosu.* --- <sup>Help Dosu learn! Give it feedback: [Great Response](https://app.dosu.dev/response-feedback/079af7ef-273d-4d5e-99d4-b0ef63de2f01?feedback_type=great_response) | [Irrelevant Answer](https://app.dosu.dev/response-feedback/079af7ef-273d-4d5e-99d4-b0ef63de2f01?feedback_type=irrelevant_answer) | [Incorrect Sources](https://app.dosu.dev/response-feedback/079af7ef-273d-4d5e-99d4-b0ef63de2f01?feedback_type=incorrect_sources) | [Too Verbose](https://app.dosu.dev/response-feedback/079af7ef-273d-4d5e-99d4-b0ef63de2f01?feedback_type=too_verbose) | [Hallucination](https://app.dosu.dev/response-feedback/079af7ef-273d-4d5e-99d4-b0ef63de2f01?feedback_type=hallucination) | [Bug Report](https://app.dosu.dev/response-feedback/079af7ef-273d-4d5e-99d4-b0ef63de2f01?feedback_type=bug_report) | [Other](https://app.dosu.dev/response-feedback/079af7ef-273d-4d5e-99d4-b0ef63de2f01?feedback_type=other)</sup>
Author
Owner

@crazywoola commented on GitHub (Mar 24, 2025):

The output should be streamed out, even with a variable aggregator

This node doesn't support streaming. This is an expected behavior.

@crazywoola commented on GitHub (Mar 24, 2025): > The output should be streamed out, even with a variable aggregator This node doesn't support streaming. This is an expected behavior.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#12046