local deploy dify install qwen model errors #16611

Closed
opened 2026-02-21 19:26:54 -05:00 by yindo · 2 comments
Owner

Originally created by @zoushuhang0 on GitHub (Sep 1, 2025).

Self Checks

  • I have read the Contributing Guide and Language Policy.
  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report, otherwise it will be closed.
  • 【中文用户 & Non English User】请使用英语提交,否则会被关闭 :)
  • Please do not modify this template :) and fill in all the required fields.

Dify version

1.6.0

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

Image

✔️ Expected Behavior

install qwen model error

Actual Behavior

No response

Originally created by @zoushuhang0 on GitHub (Sep 1, 2025). ### Self Checks - [x] I have read the [Contributing Guide](https://github.com/langgenius/dify/blob/main/CONTRIBUTING.md) and [Language Policy](https://github.com/langgenius/dify/issues/1542). - [x] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [x] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [x] I confirm that I am using English to submit this report, otherwise it will be closed. - [x] 【中文用户 & Non English User】请使用英语提交,否则会被关闭 :) - [x] Please do not modify this template :) and fill in all the required fields. ### Dify version 1.6.0 ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce <img width="462" height="336" alt="Image" src="https://github.com/user-attachments/assets/e786dee5-d2df-442c-bb31-b6a95af5b13b" /> ### ✔️ Expected Behavior install qwen model error ### ❌ Actual Behavior _No response_
yindo added the 🐞 bug label 2026-02-21 19:26:54 -05:00
yindo closed this issue 2026-02-21 19:26:54 -05:00
Author
Owner

@dosubot[bot] commented on GitHub (Sep 1, 2025):

Hi @decadezzz! I'm Dosu and I’m helping the dify team.

There are several known issues when installing Qwen models in Dify v1.6.0 (self-hosted with Docker):

  • If you see errors about "max retries exceeded" or "connection refused" when downloading plugins or models, it's often due to Docker network misconfiguration, firewall issues, or incorrect environment variables. Make sure your Docker containers can reach the plugin daemon and marketplace URLs, and that all relevant ports are open. Using HTTPS instead of HTTP for embedding Dify can also help in some cases [source].

  • For Qwen3 models, Dify's openai-api-compatible provider uses non-stream mode for validation, but Qwen3 requires streaming mode. This causes errors like "parameter.enable_thinking must be set to false for non-streaming calls" [source]. This is a known limitation; support for streaming mode validation is not yet fully exposed in Dify.

  • Some Qwen models or variants may be missing or deprecated, or not yet supported by your plugin version. Make sure both Dify and the Tongyi (Qwen) plugin are updated to the latest versions. Recent plugin updates added support for new Qwen3 models and fixed endpoint bugs [source] [source].

  • If you see errors like "Model qwen-max not exist, All models not exist", it's usually a plugin or Dify version mismatch. Upgrade Dify to at least 1.3.0+ and the Tongyi plugin to the latest version [source].

  • For persistent internal errors, try clearing the contents of your volumes/db directory and restarting the project [source].

  • Some Qwen3 models require tuning with default parameters for proper operation. If you see "invalid_param" or similar errors, check that all required parameters are set [source].

If you continue to have issues, double-check your Docker .env for correct plugin daemon and marketplace URLs, and ensure your firewall and network allow all necessary connections. If you can share the exact error message or logs, I can help you debug further.

To reply, just mention @dosu.


How did I do? Good | Irrelevant | Incorrect | Verbose | Hallucination | Report 🐛 | Other  Chat with Dosu Join Discord Share on X

@dosubot[bot] commented on GitHub (Sep 1, 2025): <!-- Greeting --> Hi @decadezzz! I'm [Dosu](https://go.dosu.dev/dosubot) and I’m helping the dify team. <!-- Answer --> There are several known issues when installing Qwen models in Dify v1.6.0 (self-hosted with Docker): - If you see errors about "max retries exceeded" or "connection refused" when downloading plugins or models, it's often due to Docker network misconfiguration, firewall issues, or incorrect environment variables. Make sure your Docker containers can reach the plugin daemon and marketplace URLs, and that all relevant ports are open. Using HTTPS instead of HTTP for embedding Dify can also help in some cases [[source]](https://github.com/langgenius/dify/issues/17165). - For Qwen3 models, Dify's openai-api-compatible provider uses non-stream mode for validation, but Qwen3 requires streaming mode. This causes errors like "parameter.enable_thinking must be set to false for non-streaming calls" [[source]](https://github.com/langgenius/dify-official-plugins/issues/1330). This is a known limitation; support for streaming mode validation is not yet fully exposed in Dify. - Some Qwen models or variants may be missing or deprecated, or not yet supported by your plugin version. Make sure both Dify and the Tongyi (Qwen) plugin are updated to the latest versions. Recent plugin updates added support for new Qwen3 models and fixed endpoint bugs [[source]](https://github.com/langgenius/dify-official-plugins/pull/1388) [[source]](https://github.com/langgenius/dify-official-plugins/pull/1156). - If you see errors like "Model qwen-max not exist, All models not exist", it's usually a plugin or Dify version mismatch. Upgrade Dify to at least 1.3.0+ and the Tongyi plugin to the latest version [[source]](https://github.com/langgenius/dify-official-plugins/issues/925#issuecomment-2886057268). - For persistent internal errors, try clearing the contents of your `volumes/db` directory and restarting the project [[source]](https://github.com/langgenius/dify/issues/15612). - Some Qwen3 models require tuning with default parameters for proper operation. If you see "invalid_param" or similar errors, check that all required parameters are set [[source]](https://github.com/langgenius/dify-official-plugins/issues/837#issuecomment-2840960914). If you continue to have issues, double-check your Docker `.env` for correct plugin daemon and marketplace URLs, and ensure your firewall and network allow all necessary connections. If you can share the exact error message or logs, I can help you debug further. <!-- Dosu Comment Footer --> *To reply, just mention [@dosu](https://go.dosu.dev/dosubot).* --- <sup>How did I do? [Good](https://app.dosu.dev/response-feedback/6c194374-5d71-4d7a-98e9-25c05aaa1850?feedback_type=great_response) | [Irrelevant](https://app.dosu.dev/response-feedback/6c194374-5d71-4d7a-98e9-25c05aaa1850?feedback_type=irrelevant_answer) | [Incorrect](https://app.dosu.dev/response-feedback/6c194374-5d71-4d7a-98e9-25c05aaa1850?feedback_type=incorrect_sources) | [Verbose](https://app.dosu.dev/response-feedback/6c194374-5d71-4d7a-98e9-25c05aaa1850?feedback_type=too_verbose) | [Hallucination](https://app.dosu.dev/response-feedback/6c194374-5d71-4d7a-98e9-25c05aaa1850?feedback_type=hallucination) | [Report 🐛](https://app.dosu.dev/response-feedback/6c194374-5d71-4d7a-98e9-25c05aaa1850?feedback_type=bug_report) | [Other](https://app.dosu.dev/response-feedback/6c194374-5d71-4d7a-98e9-25c05aaa1850?feedback_type=other)</sup>&nbsp;&nbsp;[![Chat with Dosu](https://dosu.dev/dosu-chat-badge.svg)](https://app.dosu.dev/6088a4f4-073a-43f3-b3d4-4f06fb0c05a0/ask?utm_source=github)&nbsp;[![Join Discord](https://img.shields.io/badge/join-5865F2?logo=discord&logoColor=white&label=)](https://go.dosu.dev/discord-bot)&nbsp;[![Share on X](https://img.shields.io/badge/X-share-black)](https://twitter.com/intent/tweet?text=%40dosu_ai%20helped%20me%20solve%20this%20issue!&url=https%3A//github.com/langgenius/dify/issues/24903)
Author
Owner

@crazywoola commented on GitHub (Sep 1, 2025):

Duplicated and wrong issue template

@crazywoola commented on GitHub (Sep 1, 2025): Duplicated and wrong issue template
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#16611