Failed to invoke model qwq-32b #207

Closed
opened 2026-02-16 10:18:26 -05:00 by yindo · 6 comments
Owner

Originally created by @NJCrazyRen on GitHub (Apr 17, 2025).

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

Dify version

1.2.0

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

If a knowledge base or tool is set in the agent, an error will be reported when using the Tongyi QwQ-32B model
Image

The error message is:
[tongyi] Error: PluginInvokeError: {"args":{},"error_type":"ServiceUnavailableError","message":"Failed to invoke model qwq-32b, status code: 400, message: \u003c400\u003e InternalError.Algo.InvalidParameter: This model only supports incremental_output set to

✔️ Expected Behavior

No response

Actual Behavior

No response

Originally created by @NJCrazyRen on GitHub (Apr 17, 2025). ### Self Checks - [x] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [x] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [x] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:) - [x] Please do not modify this template :) and fill in all the required fields. ### Dify version 1.2.0 ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce If a knowledge base or tool is set in the agent, an error will be reported when using the Tongyi QwQ-32B model ![Image](https://github.com/user-attachments/assets/179787ba-9256-4b03-8d03-ff58ebc63baa) The error message is: `[tongyi] Error: PluginInvokeError: {"args":{},"error_type":"ServiceUnavailableError","message":"Failed to invoke model qwq-32b, status code: 400, message: \u003c400\u003e InternalError.Algo.InvalidParameter: This model only supports incremental_output set to` ### ✔️ Expected Behavior _No response_ ### ❌ Actual Behavior _No response_
yindo closed this issue 2026-02-16 10:18:26 -05:00
Author
Owner

@dosubot[bot] commented on GitHub (Apr 17, 2025):

The error you're encountering with the Tongyi QwQ-32B model in Dify seems to be related to the incremental_output parameter. The model only supports this parameter being set to a specific value, which might be causing the ServiceUnavailableError with a 400 status code due to an invalid parameter setting.

To resolve this issue, ensure that the incremental_output parameter is correctly configured according to the model's requirements. Unfortunately, specific details about the required settings for incremental_output in the Tongyi QwQ-32B model are not available in the current documentation or codebase [1]. You might need to check any available documentation or configuration guides specific to the Tongyi QwQ-32B model for the correct parameter settings.

Additionally, if the error persists, consider reviewing the integration of knowledge bases or tools, as they can affect model invocation, especially in agent mode [2].

To continue talking to Dosu, mention @dosu.


Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Bug Report | Other

@dosubot[bot] commented on GitHub (Apr 17, 2025): <!-- Answer --> The error you're encountering with the Tongyi QwQ-32B model in Dify seems to be related to the `incremental_output` parameter. The model only supports this parameter being set to a specific value, which might be causing the `ServiceUnavailableError` with a 400 status code due to an invalid parameter setting. To resolve this issue, ensure that the `incremental_output` parameter is correctly configured according to the model's requirements. Unfortunately, specific details about the required settings for `incremental_output` in the Tongyi QwQ-32B model are not available in the current documentation or codebase <sup>[[1]](https://github.com/langgenius/dify/issues/16739)</sup>. You might need to check any available documentation or configuration guides specific to the Tongyi QwQ-32B model for the correct parameter settings. Additionally, if the error persists, consider reviewing the integration of knowledge bases or tools, as they can affect model invocation, especially in agent mode <sup>[[2]](https://github.com/langgenius/dify-docs/blob/main/en/guides/application-orchestrate/agent.md)</sup>. <!-- Dosu Comment Footer --> *To continue talking to [Dosu](https://dosu.dev), mention @dosu.* --- <sup>Help Dosu learn! Give it feedback: [Great Response](https://app.dosu.dev/response-feedback/cf5cd8fa-427f-4d3b-99fd-9d2b8f9afeb6?feedback_type=great_response) | [Irrelevant Answer](https://app.dosu.dev/response-feedback/cf5cd8fa-427f-4d3b-99fd-9d2b8f9afeb6?feedback_type=irrelevant_answer) | [Incorrect Sources](https://app.dosu.dev/response-feedback/cf5cd8fa-427f-4d3b-99fd-9d2b8f9afeb6?feedback_type=incorrect_sources) | [Too Verbose](https://app.dosu.dev/response-feedback/cf5cd8fa-427f-4d3b-99fd-9d2b8f9afeb6?feedback_type=too_verbose) | [Hallucination](https://app.dosu.dev/response-feedback/cf5cd8fa-427f-4d3b-99fd-9d2b8f9afeb6?feedback_type=hallucination) | [Bug Report](https://app.dosu.dev/response-feedback/cf5cd8fa-427f-4d3b-99fd-9d2b8f9afeb6?feedback_type=bug_report) | [Other](https://app.dosu.dev/response-feedback/cf5cd8fa-427f-4d3b-99fd-9d2b8f9afeb6?feedback_type=other)</sup>
Author
Owner

@crazywoola commented on GitHub (Apr 17, 2025):

For bugs related to plugins, you need to provide the plugin version as well.

@crazywoola commented on GitHub (Apr 17, 2025): For bugs related to plugins, you need to provide the plugin version as well.
Author
Owner

@NJCrazyRen commented on GitHub (Apr 17, 2025):

For bugs related to plugins, you need to provide the plugin version as well.

0.0.18

Image

@NJCrazyRen commented on GitHub (Apr 17, 2025): > For bugs related to plugins, you need to provide the plugin version as well. 0.0.18 ![Image](https://github.com/user-attachments/assets/e56db0f1-8c13-4110-8f08-7b2a5a5ae655)
Author
Owner

@NJCrazyRen commented on GitHub (Apr 17, 2025):

For bugs related to plugins, you need to provide the plugin version as well.

I tried 0.0.14, 0.0.15, and 0.0.16 all reported errors, but I remember that the 0.0.14 used before seemed to work fine.
In another v1.0.1 Dify deployment instance, with 0.0.14 version of the Tongyi Qianwen model plug-in, it works fine.

@NJCrazyRen commented on GitHub (Apr 17, 2025): > For bugs related to plugins, you need to provide the plugin version as well. I tried 0.0.14, 0.0.15, and 0.0.16 all reported errors, but I remember that the 0.0.14 used before seemed to work fine. In another v1.0.1 Dify deployment instance, with 0.0.14 version of the Tongyi Qianwen model plug-in, it works fine.
Author
Owner

@junjiem commented on GitHub (May 21, 2025):

Upgrade to the latest 0.0.25

@junjiem commented on GitHub (May 21, 2025): Upgrade to the latest 0.0.25
Author
Owner

@dosubot[bot] commented on GitHub (Aug 20, 2025):

Hi, @NJCrazyRen. I'm Dosu, and I'm helping the dify-official-plugins team manage their backlog and am marking this issue as stale.

Issue Summary:

  • You encountered a ServiceUnavailableError (400) related to the "incremental_output" parameter when using the Tongyi QwQ-32B model with a knowledge base or tool set in Dify v1.2.0.
  • The error was suspected to be caused by incorrect "incremental_output" settings, but specific configuration details were not provided.
  • You tested plugin versions from 0.0.14 to 0.0.18, noting that 0.0.14 worked on an older Dify instance.
  • I recommended upgrading to the latest plugin version 0.0.25 to address the issue.
  • The issue was resolved by upgrading to plugin version 0.0.25.

Next Steps:

  • Please confirm if this issue is still relevant with the latest version of the dify-official-plugins repository by commenting here.
  • If no further updates are provided, I will automatically close this issue in 5 days.

Thank you for your understanding and contribution!

@dosubot[bot] commented on GitHub (Aug 20, 2025): Hi, @NJCrazyRen. I'm [Dosu](https://dosu.dev), and I'm helping the dify-official-plugins team manage their backlog and am marking this issue as stale. **Issue Summary:** - You encountered a ServiceUnavailableError (400) related to the "incremental_output" parameter when using the Tongyi QwQ-32B model with a knowledge base or tool set in Dify v1.2.0. - The error was suspected to be caused by incorrect "incremental_output" settings, but specific configuration details were not provided. - You tested plugin versions from 0.0.14 to 0.0.18, noting that 0.0.14 worked on an older Dify instance. - I recommended upgrading to the latest plugin version 0.0.25 to address the issue. - The issue was resolved by upgrading to plugin version 0.0.25. **Next Steps:** - Please confirm if this issue is still relevant with the latest version of the dify-official-plugins repository by commenting here. - If no further updates are provided, I will automatically close this issue in 5 days. Thank you for your understanding and contribution!
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify-official-plugins#207