langgenius/dify
1
0
Fork 0
mirror of https://github.com/langgenius/dify.git synced 2026-07-21 12:05:30 -04:00
Code Issues 775 Packages Projects Releases 10 Wiki Activity

Issue with DIFY When Orchestrating Workflows Involving Visual VL Models and Standard Text Models #5829

New Issue
Closed
opened 2026-02-21 18:12:46 -05:00 by yindo · 5 comments
yindo commented 2026-02-21 18:12:46 -05:00
Owner
Copy Link
Copy Source

Originally created by @svcvit on GitHub (Sep 26, 2024).

Originally assigned to: @laipz8200 on GitHub.

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:）
  • Please do not modify this template :) and fill in all the required fields.

Dify version

0.8.3

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

I'm trying to implement a branching logic in the workflow where regular text content is processed by a standard large language model (LLM), and image content is processed by a visual VL model. However, the system parameter sys.files cannot be referenced within the if branch.

To work around this, I added a keyword "image" to sys.query. If this keyword is present, the workflow will use the visual VL model.

The workflow functions correctly during the first round of conversation. However, in the second round, which only involves text, an error occurs: Run failed: 'TextPromptMessageContent' object has no attribute 'text'.

Reference image for the first round of conversation:

Xnip2024-09-27_10-29-21

Reference image for the second round of conversation:

Xnip2024-09-27_10-29-38

✔️ Expected Behavior

Enhancement Request: I would like the if condition to support sys.files so that image-related tasks can be processed using different models.
Bug Fix: I'm also seeking a fix for the current bug.

❌ Actual Behavior

No response

Originally created by @svcvit on GitHub (Sep 26, 2024). Originally assigned to: @laipz8200 on GitHub. ### Self Checks - [X] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [X] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [X] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [X] [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:） - [X] Please do not modify this template :) and fill in all the required fields. ### Dify version 0.8.3 ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce I'm trying to implement a branching logic in the workflow where regular text content is processed by a standard large language model (LLM), and image content is processed by a visual VL model. However, the system parameter sys.files cannot be referenced within the if branch. To work around this, I added a keyword "image" to sys.query. If this keyword is present, the workflow will use the visual VL model. The workflow functions correctly during the first round of conversation. However, in the second round, which only involves text, an error occurs: Run failed: 'TextPromptMessageContent' object has no attribute 'text'. Reference image for the first round of conversation: ![Xnip2024-09-27_10-29-21](https://github.com/user-attachments/assets/fcafb944-33e5-4e44-8370-19dd6b7d460d) Reference image for the second round of conversation: ![Xnip2024-09-27_10-29-38](https://github.com/user-attachments/assets/520d505a-2487-475c-b402-c45bb65e529a) ### ✔️ Expected Behavior Enhancement Request: I would like the if condition to support sys.files so that image-related tasks can be processed using different models. Bug Fix: I'm also seeking a fix for the current bug. ### ❌ Actual Behavior _No response_
yindo added the 💪 enhancement🐞 bug labels 2026-02-21 18:12:46 -05:00
yindo closed this issue 2026-02-21 18:12:46 -05:00
yindo commented 2026-02-21 18:12:47 -05:00
Author
Owner
Copy Link
Copy Source

@dosubot[bot] commented on GitHub (Sep 26, 2024):

I found a similar unsolved discussion that might be relevant to your issue: Error in item: Invalid variable, which was last updated on September 23, 2024 [1].

Addressing Your Issues:

  1. Enhancement Request: Support for sys.files in IF Conditions

    • Currently, the sys.files parameter is used to store images uploaded by users and requires enabling the image upload function in the 'Features' section of the application orchestration page [2]. However, it seems that sys.files cannot be directly referenced within the IF condition. This enhancement would indeed be useful for workflows involving different content types.

  2. Bug Fix: 'TextPromptMessageContent' object has no attribute 'text'

    • The error 'TextPromptMessageContent' object has no attribute 'text' occurs because the TextPromptMessageContent class uses the data attribute to store text data, not text. Ensure that you are using the data attribute to access the text content.

Here is the correct way to handle TextPromptMessageContent:

from your_module import TextPromptMessageContent, PromptMessageContentType

# Correct initialization
text_content = TextPromptMessageContent(type=PromptMessageContentType.TEXT, data="Your text here")

# Accessing the text data
print(text_content.data)  # This will print "Your text here"

In your workflow, make sure to use content.data instead of content.text when dealing with TextPromptMessageContent objects [3][4].

Implementing Branching Logic Based on Content Type:

To implement branching logic based on content type, you can use the IF/ELSE node to check for the presence of images or specific keywords in sys.query. Here is an example of how to set up such a workflow:

  1. IF/ELSE Node: Use this node to check if sys.query contains the keyword "image".
  2. Branch for Image Content: If the condition is met, process the content using the visual VL model.
  3. Branch for Text Content: If the condition is not met, process the content using the standard LLM.

This approach allows you to handle different types of content within the same workflow [5][6].

By addressing these points, you should be able to enhance your workflow and resolve the current bug.

To continue talking to Dosu, mention @dosu.

@dosubot[bot] commented on GitHub (Sep 26, 2024): <!-- Answer --> I found a similar unsolved discussion that might be relevant to your issue: [Error in item: Invalid variable](https://github.com/langgenius/dify/discussions/8611), which was last updated on September 23, 2024 <sup>[[1]](https://github.com/langgenius/dify/discussions/8611)</sup>. ### Addressing Your Issues: 1. **Enhancement Request: Support for `sys.files` in IF Conditions** - Currently, the `sys.files` parameter is used to store images uploaded by users and requires enabling the image upload function in the 'Features' section of the application orchestration page <sup>[[2]](https://github.com/langgenius/dify-docs/blob/main/en/guides/workflow/variables.md)</sup>. However, it seems that `sys.files` cannot be directly referenced within the IF condition. This enhancement would indeed be useful for workflows involving different content types. 2. **Bug Fix: 'TextPromptMessageContent' object has no attribute 'text'** - The error `'TextPromptMessageContent' object has no attribute 'text'` occurs because the `TextPromptMessageContent` class uses the `data` attribute to store text data, not `text`. Ensure that you are using the `data` attribute to access the text content. Here is the correct way to handle `TextPromptMessageContent`: ```python from your_module import TextPromptMessageContent, PromptMessageContentType # Correct initialization text_content = TextPromptMessageContent(type=PromptMessageContentType.TEXT, data="Your text here") # Accessing the text data print(text_content.data) # This will print "Your text here" ``` In your workflow, make sure to use `content.data` instead of `content.text` when dealing with `TextPromptMessageContent` objects <sup>[[3]](https://github.com/langgenius/dify/blob/main/api/core/model_runtime/docs/en_US/interfaces.md)</sup><sup>[[4]](https://github.com/langgenius/dify-docs/blob/main/en/guides/model-configuration/interfaces.md)</sup>. ### Implementing Branching Logic Based on Content Type: To implement branching logic based on content type, you can use the IF/ELSE node to check for the presence of images or specific keywords in `sys.query`. Here is an example of how to set up such a workflow: 1. **IF/ELSE Node**: Use this node to check if `sys.query` contains the keyword "image". 2. **Branch for Image Content**: If the condition is met, process the content using the visual VL model. 3. **Branch for Text Content**: If the condition is not met, process the content using the standard LLM. This approach allows you to handle different types of content within the same workflow <sup>[[5]](https://github.com/langgenius/dify-docs/blob/main/zh_CN/guides/workflow/node/README.md)</sup><sup>[[6]](https://github.com/langgenius/dify-docs/blob/main/jp/guides/workflow/node/README.md)</sup>. By addressing these points, you should be able to enhance your workflow and resolve the current bug. <!-- Dosu Comment Footer --> *To continue talking to [Dosu](https://dosu.dev), mention @dosu.*
yindo commented 2026-02-21 18:12:47 -05:00
Author
Owner
Copy Link
Copy Source

@crazywoola commented on GitHub (Sep 26, 2024):

Link https://github.com/langgenius/dify/issues/8777, not sure if is resolved.

@crazywoola commented on GitHub (Sep 26, 2024): Link https://github.com/langgenius/dify/issues/8777, not sure if is resolved.
yindo commented 2026-02-21 18:12:47 -05:00
Author
Owner
Copy Link
Copy Source

@svcvit commented on GitHub (Sep 27, 2024):

I tried pulling the latest merged code and switched to developer mode, but the error still persists.

If I first send an image with text, it follows the visual processing branch and responds correctly. However, when I then send a text-only message, it throws this error.

Additionally, there's another issue—sys.files can't be used as a condition in an if statement. Is there any way to optimize this?

Xnip2024-09-27_12-33-14

@svcvit commented on GitHub (Sep 27, 2024): I tried pulling the latest merged code and switched to developer mode, but the error still persists. If I first send an image with text, it follows the visual processing branch and responds correctly. However, when I then send a text-only message, it throws this error. Additionally, there's another issue—sys.files can't be used as a condition in an if statement. Is there any way to optimize this? ![Xnip2024-09-27_12-33-14](https://github.com/user-attachments/assets/ab0946aa-8abc-42b6-b5ac-155bb0d0d526)
yindo commented 2026-02-21 18:12:47 -05:00
Author
Owner
Copy Link
Copy Source

@free-cx commented on GitHub (Sep 27, 2024):

This bug is related to enabling memory in the node.

@free-cx commented on GitHub (Sep 27, 2024): This bug is related to enabling memory in the node.
yindo commented 2026-02-21 18:12:47 -05:00
Author
Owner
Copy Link
Copy Source

@laipz8200 commented on GitHub (Sep 27, 2024):

We'll provide full file-type support in future versions.

@laipz8200 commented on GitHub (Sep 27, 2024): We'll provide full file-type support in future versions.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Knowledge Pipeline
Proposal
WIP
cloud
dependencies
feat:webapp
good first issue
outdated
performance
pull-request
Mirrored from GitHub Pull Request
 python:uv
refactor
size:L
stale
status: accepting prs
status: blocked
status: in discussion
stt & tts
vulnerablity
web
wont-fix
🌊 feat:workflow
🌚 invalid
🐞 bug
👻 feat:rag
💪 enhancement
📚 documentation
🔨 feat:tools
🙋‍♂️ question
🙏 help wanted
🤔 cant-reproduce
🤖 feat:agent
No Label 🐞 bug 💪 enhancement
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#5829
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?