Add chain-of-thought support for the Deepseek R1 model in Xinference #7933

Closed
opened 2026-02-21 18:23:07 -05:00 by yindo · 1 comment
Owner

Originally created by @Vastzhang97 on GitHub (Jan 31, 2025).

Self Checks

  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

When running the deepseek-r1-distill-qwen model through xinference, the chain-of-thought of the R1 model was not properly handled in both chatbot and workflow scenarios.
Thank you!
Image

Image

Image

2. Additional context or comments

No response

3. Can you help us with this feature?

  • I am interested in contributing to this feature.
Originally created by @Vastzhang97 on GitHub (Jan 31, 2025). ### Self Checks - [x] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [x] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:) - [x] Please do not modify this template :) and fill in all the required fields. ### 1. Is this request related to a challenge you're experiencing? Tell me about your story. When running the deepseek-r1-distill-qwen model through xinference, the chain-of-thought of the R1 model was not properly handled in both chatbot and workflow scenarios. Thank you! ![Image](https://github.com/user-attachments/assets/8ae6a763-db6b-4571-8bbd-b87c3698b69e) ![Image](https://github.com/user-attachments/assets/18316a97-5244-40fb-9a45-8e6fd4056c85) ![Image](https://github.com/user-attachments/assets/f2786e5b-ff0a-477d-8394-1dfa9d4a4819) ### 2. Additional context or comments _No response_ ### 3. Can you help us with this feature? - [ ] I am interested in contributing to this feature.
yindo added the good first issue label 2026-02-21 18:23:07 -05:00
yindo closed this issue 2026-02-21 18:23:07 -05:00
Author
Owner

@hjlarry commented on GitHub (Feb 2, 2025):

You can refer to this PR https://github.com/langgenius/dify/pull/13153 to implement this feature.

@hjlarry commented on GitHub (Feb 2, 2025): You can refer to this PR https://github.com/langgenius/dify/pull/13153 to implement this feature.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#7933