langgenius/dify-official-plugins
1
0
Fork 0
mirror of https://github.com/langgenius/dify-official-plugins.git synced 2026-07-21 17:45:23 -04:00
Code Issues 54 Packages Projects Releases Wiki Activity

Xorbits Inference supports the thinking and non-thinking mode switching of qwen 3 deployed by vllm #257

New Issue
Closed
opened 2026-02-16 10:18:37 -05:00 by yindo · 2 comments
yindo commented 2026-02-16 10:18:37 -05:00
Owner
Copy Link
Copy Source

Originally created by @xiaoyesoso on GitHub (May 7, 2025).

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues Dify issues & Dify Official Plugins, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:）
  • Please do not modify this template :) and fill in all the required fields.

Dify version

1.3.1

Plugin version

langgenius / xinference：0.0.3

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

Image

Currently, it is not possible to pass parameters like
'''
chat_template_kwargs": {"enable_thinking": false}
"'. For details, see:
https://qwen.readthedocs.io/zh-cn/latest/deployment/vllm.html#thinking-non-thinking-modes

Only deep thinking can be performed：

Image

✔️ Error log

No response

Originally created by @xiaoyesoso on GitHub (May 7, 2025). ### Self Checks - [x] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [x] I have searched for existing issues [Dify issues](https://github.com/langgenius/dify/issues) & [Dify Official Plugins](https://github.com/langgenius/dify-official-plugins/issues), including closed ones. - [x] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:） - [x] Please do not modify this template :) and fill in all the required fields. ### Dify version 1.3.1 ### Plugin version langgenius / xinference：0.0.3 ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce <img width="729" alt="Image" src="https://github.com/user-attachments/assets/942fc19e-ce89-4127-b76c-4c673da8e1b5" /> Currently, it is not possible to pass parameters like ''' chat_template_kwargs": {"enable_thinking": false} "'. For details, see: https://qwen.readthedocs.io/zh-cn/latest/deployment/vllm.html#thinking-non-thinking-modes Only deep thinking can be performed： <img width="705" alt="Image" src="https://github.com/user-attachments/assets/42ae0a97-ff18-488c-8500-ffc84fbc4279" /> ### ✔️ Error log _No response_
yindo added the bug label 2026-02-16 10:18:37 -05:00
yindo closed this issue 2026-02-16 10:18:37 -05:00
yindo commented 2026-02-16 10:18:37 -05:00
Author
Owner
Copy Link
Copy Source

@qqlww1987 commented on GitHub (Jun 22, 2025):

+10086

@qqlww1987 commented on GitHub (Jun 22, 2025): +10086
yindo commented 2026-02-16 10:18:37 -05:00
Author
Owner
Copy Link
Copy Source

@dosubot[bot] commented on GitHub (Aug 19, 2025):

Hi, @xiaoyesoso. I'm Dosu, and I'm helping the dify-official-plugins team manage their backlog and am marking this issue as stale.

Issue Summary:

  • You reported that in Dify v1.3.1 with the xinference plugin (v0.0.3) self-hosted via Docker, switching between thinking and non-thinking modes for the Qwen 3 model deployed by vllm is not supported.
  • The documentation suggests mode switching should be possible, but currently only deep thinking mode works.
  • You requested enabling mode switching via parameters like "chat_template_kwargs": {"enable_thinking": false}.
  • Another user expressed strong agreement with your request.
  • The issue remains unresolved with no updates or fixes implemented yet.

Next Steps:

  • Please let me know if this issue is still relevant with the latest version of dify-official-plugins by commenting here to keep the discussion open.
  • Otherwise, I will automatically close this issue in 5 days.

Thank you for your understanding and contribution!

@dosubot[bot] commented on GitHub (Aug 19, 2025): Hi, @xiaoyesoso. I'm [Dosu](https://dosu.dev), and I'm helping the dify-official-plugins team manage their backlog and am marking this issue as stale. **Issue Summary:** - You reported that in Dify v1.3.1 with the xinference plugin (v0.0.3) self-hosted via Docker, switching between thinking and non-thinking modes for the Qwen 3 model deployed by vllm is not supported. - The documentation suggests mode switching should be possible, but currently only deep thinking mode works. - You requested enabling mode switching via parameters like `"chat_template_kwargs": {"enable_thinking": false}`. - Another user expressed strong agreement with your request. - The issue remains unresolved with no updates or fixes implemented yet. **Next Steps:** - Please let me know if this issue is still relevant with the latest version of dify-official-plugins by commenting here to keep the discussion open. - Otherwise, I will automatically close this issue in 5 days. Thank you for your understanding and contribution!
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
bug
bug
dependencies
documentation
enhancement
good first issue
invalid
pull-request
Mirrored from GitHub Pull Request
 question
stale
No Label bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify-official-plugins#257
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?