Support enabling/disabling deep reasoning in Xorbits Inference (similar to Ollama) #905

Closed
opened 2026-02-16 10:20:54 -05:00 by yindo · 1 comment
Owner

Originally created by @Alysondao on GitHub (Dec 27, 2025).

Self Checks

  • I have read the Contributing Guide and Language Policy.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report, otherwise it will be closed.
  • Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

I am using Xorbits Inference to serve LLMs for different scenarios, including real-time chat and automated tasks.

In some cases, I want the model to perform deep reasoning (e.g. complex problem solving), but in many production scenarios (such as latency-sensitive chat, tool calling, or simple Q&A), deep reasoning is unnecessary and even undesirable due to increased latency and token usage.

Currently, Xorbits Inference does not seem to provide an explicit option to enable or disable deep reasoning behavior. This makes it harder to balance performance, cost, and response quality across different use cases.

By contrast, tools like Ollama expose a clear switch or configuration to control whether “deep thinking / reasoning” is enabled, which is very helpful in practice.

2. Additional context or comments

I suggest adding a configurable option (API parameter, model config, or runtime flag) to explicitly control deep reasoning behavior, for example:

enable / disable deep reasoning

3. Can you help us with this feature?

  • I am interested in contributing to this feature.
Originally created by @Alysondao on GitHub (Dec 27, 2025). ### Self Checks - [x] I have read the [Contributing Guide](https://github.com/langgenius/dify/blob/main/CONTRIBUTING.md) and [Language Policy](https://github.com/langgenius/dify/issues/1542). - [x] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify-official-plugins/issues), including closed ones. - [x] I confirm that I am using English to submit this report, otherwise it will be closed. - [x] Please do not modify this template :) and fill in all the required fields. ### 1. Is this request related to a challenge you're experiencing? Tell me about your story. I am using Xorbits Inference to serve LLMs for different scenarios, including real-time chat and automated tasks. In some cases, I want the model to perform deep reasoning (e.g. complex problem solving), but in many production scenarios (such as latency-sensitive chat, tool calling, or simple Q&A), deep reasoning is unnecessary and even undesirable due to increased latency and token usage. Currently, Xorbits Inference does not seem to provide an explicit option to enable or disable deep reasoning behavior. This makes it harder to balance performance, cost, and response quality across different use cases. By contrast, tools like Ollama expose a clear switch or configuration to control whether “deep thinking / reasoning” is enabled, which is very helpful in practice. ### 2. Additional context or comments I suggest adding a configurable option (API parameter, model config, or runtime flag) to explicitly control deep reasoning behavior, for example: enable / disable deep reasoning ### 3. Can you help us with this feature? - [x] I am interested in contributing to this feature.
yindo added the enhancement label 2026-02-16 10:20:54 -05:00
yindo closed this issue 2026-02-16 10:20:54 -05:00
Author
Owner

@dosubot[bot] commented on GitHub (Jan 12, 2026):

Hi, @Alysondao. I'm Dosu, and I'm helping the dify-official-plugins team manage their backlog and am marking this issue as stale.

Issue Summary:

  • You requested a configurable option in Xorbits Inference to toggle deep reasoning, similar to Ollama's feature.
  • The goal is to balance performance, cost, and response quality for different use cases.
  • You highlighted benefits for both real-time chat and complex problem-solving scenarios.
  • You expressed interest in contributing to this feature's development.
  • There has been no further activity or comments on this issue since your initial request.

Next Steps:

  • Please let me know if this feature request is still relevant to the latest version of dify-official-plugins by commenting on this issue.
  • If I do not hear back within 5 days, I will automatically close this issue.

Thank you for your understanding and contribution!

@dosubot[bot] commented on GitHub (Jan 12, 2026): Hi, @Alysondao. I'm [Dosu](https://dosu.dev), and I'm helping the dify-official-plugins team manage their backlog and am marking this issue as stale. **Issue Summary:** - You requested a configurable option in Xorbits Inference to toggle deep reasoning, similar to Ollama's feature. - The goal is to balance performance, cost, and response quality for different use cases. - You highlighted benefits for both real-time chat and complex problem-solving scenarios. - You expressed interest in contributing to this feature's development. - There has been no further activity or comments on this issue since your initial request. **Next Steps:** - Please let me know if this feature request is still relevant to the latest version of dify-official-plugins by commenting on this issue. - If I do not hear back within 5 days, I will automatically close this issue. Thank you for your understanding and contribution!
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify-official-plugins#905