A significant bug when processing in batch mode that includes multiple LLM results. #5198

Closed
opened 2026-02-21 18:09:49 -05:00 by yindo · 5 comments
Owner

Originally created by @NirvanaProduct on GitHub (Aug 25, 2024).

Originally assigned to: @JzoNgKVO on GitHub.

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

Dify version

0.7.1

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

Design a workflow where the output variable at the end contains the results of multiple LLM runs, and then run batches.
image
screenshot-20240825-161327

✔️ Expected Behavior

Get the sum of multiple LLM output results.

screenshot-20240825-161327

Actual Behavior

Only received the content from one of the LLM outputs.

Originally created by @NirvanaProduct on GitHub (Aug 25, 2024). Originally assigned to: @JzoNgKVO on GitHub. ### Self Checks - [X] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [X] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [X] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [X] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:) - [X] Please do not modify this template :) and fill in all the required fields. ### Dify version 0.7.1 ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce Design a workflow where the output variable at the end contains the results of multiple LLM runs, and then run batches. ![image](https://github.com/user-attachments/assets/9a69e973-913a-4d23-b48c-5e1a3196fb49) ![screenshot-20240825-161327](https://github.com/user-attachments/assets/1966a722-7395-4711-96f7-2cae1436514c) ### ✔️ Expected Behavior Get the sum of multiple LLM output results. ![screenshot-20240825-161327](https://github.com/user-attachments/assets/c89a14e8-bb5e-482b-aa3d-e1604db75c31) ### ❌ Actual Behavior Only received the content from one of the LLM outputs.
yindo closed this issue 2026-02-21 18:09:49 -05:00
Author
Owner

@NirvanaProduct commented on GitHub (Aug 25, 2024):

screenshot-20240825-161942

@NirvanaProduct commented on GitHub (Aug 25, 2024): ![screenshot-20240825-161942](https://github.com/user-attachments/assets/7d18c609-1f3a-4e34-bc11-079211c1632d)
Author
Owner

@crazywoola commented on GitHub (Aug 25, 2024):

This is an expected behavior, if you would like to have multiple results from different LLMs. Use like this.

QQ_1724579481061

@crazywoola commented on GitHub (Aug 25, 2024): This is an expected behavior, if you would like to have multiple results from different LLMs. Use like this. ![QQ_1724579481061](https://github.com/user-attachments/assets/49c0ab05-3ccd-480d-8ab0-ad28c25fe734)
Author
Owner

@NirvanaProduct commented on GitHub (Aug 25, 2024):

@crazywoola I am using the workflow mode, not the chat assistant model. In the workflow mode, there is no "direct reply", only "end", and "end" cannot appear multiple times

@NirvanaProduct commented on GitHub (Aug 25, 2024): @crazywoola I am using the workflow mode, not the chat assistant model. In the workflow mode, there is no "direct reply", only "end", and "end" cannot appear multiple times
Author
Owner

@NirvanaProduct commented on GitHub (Aug 25, 2024):

@crazywoola We are using workflow mode because only workflow mode can use batch processing functionality. In workflow mode, it seems that content can only be output through "end".
screenshot-20240825-200151

@NirvanaProduct commented on GitHub (Aug 25, 2024): @crazywoola We are using workflow mode because only workflow mode can use batch processing functionality. In workflow mode, it seems that content can only be output through "end". ![screenshot-20240825-200151](https://github.com/user-attachments/assets/9bd278d5-2f11-4cfd-a058-8eac2ffc94d7)
Author
Owner

@WYY030903 commented on GitHub (Sep 3, 2024):

Did anyone fix this bug? We face the siminar condition in dify v6.15.
image

@WYY030903 commented on GitHub (Sep 3, 2024): Did anyone fix this bug? We face the siminar condition in dify v6.15. ![image](https://github.com/user-attachments/assets/10df17b7-993f-440f-9d4c-7bd5b73deae3)
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#5198