400 Error when selecting LLM model in GPUStack deployment of Qwen3-32B-GGUF #303

Closed
opened 2026-02-16 10:18:54 -05:00 by yindo · 2 comments
Owner

Originally created by @UGhost-X on GitHub (May 20, 2025).

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues Dify issues & Dify Official Plugins, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

Dify version

1.3.1

Plugin version

0.0.7

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

Set up GPUStack with Qwen3-32B-GGUF model
Attempt to select the model as an LLM model
Observe 400 error response
Select the same model as an embeddings model
No error occurs

Image

Image

Image

✔️ Error log

No response

Originally created by @UGhost-X on GitHub (May 20, 2025). ### Self Checks - [x] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [x] I have searched for existing issues [Dify issues](https://github.com/langgenius/dify/issues) & [Dify Official Plugins](https://github.com/langgenius/dify-official-plugins/issues), including closed ones. - [x] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:) - [x] Please do not modify this template :) and fill in all the required fields. ### Dify version 1.3.1 ### Plugin version 0.0.7 ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce Set up GPUStack with Qwen3-32B-GGUF model Attempt to select the model as an LLM model Observe 400 error response Select the same model as an embeddings model No error occurs ![Image](https://github.com/user-attachments/assets/58e38737-74f9-42e2-9d92-27ec84e15882) ![Image](https://github.com/user-attachments/assets/8a48a41a-7dc8-4bd9-8ba5-7801385cdfbf) ![Image](https://github.com/user-attachments/assets/6e2a57f6-a679-43bc-83b8-9d89dc6367f3) ### ✔️ Error log _No response_
yindo added the bug label 2026-02-16 10:18:54 -05:00
yindo closed this issue 2026-02-16 10:18:54 -05:00
Author
Owner

@linyinli commented on GitHub (Jun 18, 2025):

Please update the GPUStack plugin to 0.0.8.

@linyinli commented on GitHub (Jun 18, 2025): Please update the GPUStack plugin to 0.0.8.
Author
Owner

@dosubot[bot] commented on GitHub (Aug 19, 2025):

Hi, @UGhost-X. I'm Dosu, and I'm helping the dify-official-plugins team manage their backlog and am marking this issue as stale.

Issue Summary:

  • You encountered a 400 error when selecting the Qwen3-32B-GGUF model as an LLM in a GPUStack deployment using Dify v1.3.1 and plugin v0.0.7.
  • Using the same model as an embeddings model worked without issues.
  • The setup was a self-hosted Docker environment, and no error logs were initially provided.
  • Maintainer linyinli recommended updating the GPUStack plugin to version 0.0.8.
  • Updating to plugin v0.0.8 resolved the 400 error issue.

Next Steps:

  • Please confirm if this issue remains relevant with the latest versions of Dify and the GPUStack plugin.
  • If it is still a problem, feel free to comment to keep the discussion open; otherwise, I will automatically close this issue in 5 days.

Thank you for your understanding and contribution!

@dosubot[bot] commented on GitHub (Aug 19, 2025): Hi, @UGhost-X. I'm [Dosu](https://dosu.dev), and I'm helping the dify-official-plugins team manage their backlog and am marking this issue as stale. **Issue Summary:** - You encountered a 400 error when selecting the Qwen3-32B-GGUF model as an LLM in a GPUStack deployment using Dify v1.3.1 and plugin v0.0.7. - Using the same model as an embeddings model worked without issues. - The setup was a self-hosted Docker environment, and no error logs were initially provided. - Maintainer linyinli recommended updating the GPUStack plugin to version 0.0.8. - Updating to plugin v0.0.8 resolved the 400 error issue. **Next Steps:** - Please confirm if this issue remains relevant with the latest versions of Dify and the GPUStack plugin. - If it is still a problem, feel free to comment to keep the discussion open; otherwise, I will automatically close this issue in 5 days. Thank you for your understanding and contribution!
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify-official-plugins#303