R1 model thought process deployed on inference exhibits errors #8435

Closed
opened 2026-02-21 18:25:41 -05:00 by yindo · 2 comments
Owner

Originally created by @shatang123 on GitHub (Feb 19, 2025).

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

Dify version

0.15.3

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

The model has output thinking, but the UI doesn't show this
Image

✔️ Expected Behavior

Show the thought process normally

Actual Behavior

Even though the model outputs a tag, the UI is still not well-formatted to show the thought process

Originally created by @shatang123 on GitHub (Feb 19, 2025). ### Self Checks - [x] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [x] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [x] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:) - [x] Please do not modify this template :) and fill in all the required fields. ### Dify version 0.15.3 ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce The model has output thinking, but the UI doesn't show this ![Image](https://github.com/user-attachments/assets/93f8e1b5-4639-4444-892a-ee5bd8b579c3) ### ✔️ Expected Behavior Show the thought process normally ### ❌ Actual Behavior Even though the model outputs a <think> tag, the UI is still not well-formatted to show the thought process
yindo added the 🐞 bug label 2026-02-21 18:25:41 -05:00
yindo closed this issue 2026-02-21 18:25:41 -05:00
Author
Owner

@dosubot[bot] commented on GitHub (Feb 19, 2025):

The issue you're experiencing with the R1 model's thought process not displaying correctly in the UI for Dify version 0.15.3 is a known problem. This occurs because there is incomplete support for the <think> tag content across different providers in this version. Specifically, Openrouter's DeepSeek-R1 model does not output the Thinking tag due to this incomplete support. This limitation affects only the Debug mode, and the thinking content displays normally in the chat window after the app is released.

The feature has been moved to the frontend and is not yet fully implemented for all providers, but this is a known issue that will be addressed in future updates once the API becomes stable across different providers. The <think> tag functionality has been restored in PR #13392 and will be available in the next version release after v0.15.3. Currently, in v0.15.3, this feature is not supported due to incomplete implementation across different providers, and no immediate workaround is available. Users can wait for the next version update to get this functionality [1][2][3].

To continue talking to Dosu, mention @dosu.


Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Bug Report | Other

@dosubot[bot] commented on GitHub (Feb 19, 2025): <!-- Answer --> The issue you're experiencing with the R1 model's thought process not displaying correctly in the UI for Dify version 0.15.3 is a known problem. This occurs because there is incomplete support for the `<think>` tag content across different providers in this version. Specifically, Openrouter's DeepSeek-R1 model does not output the Thinking tag due to this incomplete support. This limitation affects only the Debug mode, and the thinking content displays normally in the chat window after the app is released. The feature has been moved to the frontend and is not yet fully implemented for all providers, but this is a known issue that will be addressed in future updates once the API becomes stable across different providers. The `<think>` tag functionality has been restored in PR #13392 and will be available in the next version release after v0.15.3. Currently, in v0.15.3, this feature is not supported due to incomplete implementation across different providers, and no immediate workaround is available. Users can wait for the next version update to get this functionality <sup>[[1]](https://github.com/langgenius/dify/issues/13776)</sup><sup>[[2]](https://github.com/langgenius/dify/issues/13590)</sup><sup>[[3]](https://github.com/langgenius/dify/issues/13419)</sup>. <!-- Dosu Comment Footer --> *To continue talking to [Dosu](https://dosu.dev), mention @dosu.* --- <sup>Help Dosu learn! Give it feedback: [Great Response](https://app.dosu.dev/response-feedback/2da6ff90-4755-4915-872f-1bc37ec596b0?feedback_type=great_response) | [Irrelevant Answer](https://app.dosu.dev/response-feedback/2da6ff90-4755-4915-872f-1bc37ec596b0?feedback_type=irrelevant_answer) | [Incorrect Sources](https://app.dosu.dev/response-feedback/2da6ff90-4755-4915-872f-1bc37ec596b0?feedback_type=incorrect_sources) | [Too Verbose](https://app.dosu.dev/response-feedback/2da6ff90-4755-4915-872f-1bc37ec596b0?feedback_type=too_verbose) | [Hallucination](https://app.dosu.dev/response-feedback/2da6ff90-4755-4915-872f-1bc37ec596b0?feedback_type=hallucination) | [Bug Report](https://app.dosu.dev/response-feedback/2da6ff90-4755-4915-872f-1bc37ec596b0?feedback_type=bug_report) | [Other](https://app.dosu.dev/response-feedback/2da6ff90-4755-4915-872f-1bc37ec596b0?feedback_type=other)</sup>
Author
Owner

@crazywoola commented on GitHub (Feb 19, 2025):

https://github.com/langgenius/dify/issues/13590#issuecomment-2652881429

@crazywoola commented on GitHub (Feb 19, 2025): https://github.com/langgenius/dify/issues/13590#issuecomment-2652881429
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#8435