Use ollama model "moondream" to do a vision predition , dify returns an error :<DETAIL.LOW: 'low'>)] is not valid #4588

Closed
opened 2026-02-21 18:07:08 -05:00 by yindo · 3 comments
Owner

Originally created by @nne998 on GitHub (Jul 12, 2024).

Self Checks

  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

Use ollama model "moondream" to do a vision predition , dify got this error :

<DETAIL.LOW: 'low'>)] is not valid. Should be a string, a list/tuple of strings or a list/tuple of integers.

2. Additional context or comments

model url : https://ollama.com/library/moondream

DSL file :
moondream_1.8b_test.yml.zip

3. Can you help us with this feature?

  • I am interested in contributing to this feature.
Originally created by @nne998 on GitHub (Jul 12, 2024). ### Self Checks - [X] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [X] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [X] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:) - [X] Please do not modify this template :) and fill in all the required fields. ### 1. Is this request related to a challenge you're experiencing? Tell me about your story. Use ollama model "moondream" to do a vision predition , dify got this error : <DETAIL.LOW: 'low'>)] is not valid. Should be a string, a list/tuple of strings or a list/tuple of integers. ### 2. Additional context or comments model url : https://ollama.com/library/moondream DSL file : [moondream_1.8b_test.yml.zip](https://github.com/user-attachments/files/16192544/moondream_1.8b_test.yml.zip) ### 3. Can you help us with this feature? - [ ] I am interested in contributing to this feature.
yindo added the 🐞 bug label 2026-02-21 18:07:08 -05:00
yindo closed this issue 2026-02-21 18:07:08 -05:00
Author
Owner

@dosubot[bot] commented on GitHub (Jul 12, 2024):

The error you're encountering suggests that the input format for the "moondream" model's vision prediction is incorrect. Specifically, the value for <DETAIL.LOW: 'low'> should be a string, a list/tuple of strings, or a list/tuple of integers.

To resolve this, ensure that your input adheres to the required format for vision predictions. The "moondream" model requires images as input, which can be uploaded either locally or via URL. Additionally, the model can operate in both high and low resolution modes. Here is an example of how to structure your input:

{
  "function_call": {
    "name": "vision_prediction",
    "arguments": {
      "image": "URL_or_local_path_to_image",
      "resolution": "low"  // or "high"
    }
  }
}

Make sure to replace "URL_or_local_path_to_image" with the actual path or URL of your image and set the "resolution" to either "low" or "high" as required.

If the error persists, double-check the documentation for any additional input format requirements specific to the "moondream" model [1].

To continue talking to Dosu, mention @dosu.

@dosubot[bot] commented on GitHub (Jul 12, 2024): <!-- Answer --> The error you're encountering suggests that the input format for the "moondream" model's vision prediction is incorrect. Specifically, the value for `<DETAIL.LOW: 'low'>` should be a string, a list/tuple of strings, or a list/tuple of integers. To resolve this, ensure that your input adheres to the required format for vision predictions. The "moondream" model requires images as input, which can be uploaded either locally or via URL. Additionally, the model can operate in both high and low resolution modes. Here is an example of how to structure your input: ```json { "function_call": { "name": "vision_prediction", "arguments": { "image": "URL_or_local_path_to_image", "resolution": "low" // or "high" } } } ``` Make sure to replace `"URL_or_local_path_to_image"` with the actual path or URL of your image and set the `"resolution"` to either `"low"` or `"high"` as required. If the error persists, double-check the documentation for any additional input format requirements specific to the "moondream" model <sup>[[1]](https://github.com/langgenius/dify/blob/main/web/i18n/zh-Hant/app-debug.ts)</sup>. <!-- Dosu Comment Footer --> *To continue talking to [Dosu](https://dosu.dev), mention @dosu.*
Author
Owner

@nne998 commented on GitHub (Jul 12, 2024):

F**K the dosu bot 👎 ?

@nne998 commented on GitHub (Jul 12, 2024): F**K the dosu bot 👎 ?
Author
Owner

@crazywoola commented on GitHub (Jul 12, 2024):

Please be kind to the bot.

@crazywoola commented on GitHub (Jul 12, 2024): Please be kind to the bot.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#4588