langgenius/dify-official-plugins
1
0
Fork 0
mirror of https://github.com/langgenius/dify-official-plugins.git synced 2026-07-22 01:55:27 -04:00
Code Issues 54 Packages Projects Releases Wiki Activity

Dify's Xinfrence plug-in does not support thinking model switch control and output format control. Xinference has officially tested this part of the function, but it is not displayed here in dify. #710

New Issue
Closed
opened 2026-02-16 10:20:15 -05:00 by yindo · 7 comments
yindo commented 2026-02-16 10:20:15 -05:00
Owner
Copy Link
Copy Source

Originally created by @bianningtao on GitHub (Oct 13, 2025).

Self Checks

  • I have read the Contributing Guide and Language Policy.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report, otherwise it will be closed.
  • Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

Dify's xinfrence plug-in does not support thinking model switch control and output format control. Xinference has officially tested this part of the function, but it is not displayed on dify. The qwen series already supports this part of the function. I use the model deployed privately by xinfrence.

Xinfrence plugin version is 0.0.7

2. Additional context or comments

No response

3. Can you help us with this feature?

  • I am interested in contributing to this feature.
Originally created by @bianningtao on GitHub (Oct 13, 2025). ### Self Checks - [x] I have read the [Contributing Guide](https://github.com/langgenius/dify/blob/main/CONTRIBUTING.md) and [Language Policy](https://github.com/langgenius/dify/issues/1542). - [x] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify-official-plugins/issues), including closed ones. - [x] I confirm that I am using English to submit this report, otherwise it will be closed. - [x] Please do not modify this template :) and fill in all the required fields. ### 1. Is this request related to a challenge you're experiencing? Tell me about your story. Dify's xinfrence plug-in does not support thinking model switch control and output format control. Xinference has officially tested this part of the function, but it is not displayed on dify. The qwen series already supports this part of the function. I use the model deployed privately by xinfrence. Xinfrence plugin version is 0.0.7 ### 2. Additional context or comments _No response_ ### 3. Can you help us with this feature? - [x] I am interested in contributing to this feature.
yindo added the enhancement label 2026-02-16 10:20:15 -05:00
yindo closed this issue 2026-02-16 10:20:16 -05:00
yindo commented 2026-02-16 10:20:16 -05:00
Author
Owner
Copy Link
Copy Source

@dosubot[bot] commented on GitHub (Oct 13, 2025):

Hi @bianningtao! I'm Dosu and I’m helping the dify-official-plugins team.

You're correct: the Xinfrence plugin (v0.0.7) for Dify does not currently support model switch control or output format control, even though Xinference itself supports these features and other plugins (like Qwen/Tongyi) have implemented them. This gap is tracked in an open issue labeled "help wanted" for contributions.

To add these features, you can look at how plugins like OpenRouter and Tongyi/Qwen handle them. For example, they add parameters such as enable_thinking, reasoning_budget, and response_format in their model YAML files and handle these in the Python code to pass the correct options to the backend API. The Xinfrence plugin would need similar updates: extend the model schema to accept these parameters, update the invocation logic to forward them to Xinference, and ensure the UI/config exposes these controls to users. You can use the Qwen or OpenRouter plugin implementations as a reference for both parameter handling and config structure [OpenRouter example] [Tongyi/Qwen example].

If you want to contribute, start by updating the Xinfrence plugin's model schema and invocation logic to support these parameters, then test with your private Xinference deployment. The open issue (#1854) is the right place to coordinate or discuss your approach.

To reply, just mention @dosu.

How did I do? Good | Irrelevant | Incorrect | Verbose | Hallucination | Report 🐛 | Other  Join Discord Share on X

@dosubot[bot] commented on GitHub (Oct 13, 2025): <!-- Greeting --> Hi @bianningtao! I'm [Dosu](https://go.dosu.dev/dosubot) and I’m helping the dify-official-plugins team. <!-- Answer --> You're correct: the Xinfrence plugin (v0.0.7) for Dify does not currently support model switch control or output format control, even though Xinference itself supports these features and other plugins (like Qwen/Tongyi) have implemented them. This gap is tracked in an open issue labeled "help wanted" for contributions. To add these features, you can look at how plugins like OpenRouter and Tongyi/Qwen handle them. For example, they add parameters such as `enable_thinking`, `reasoning_budget`, and `response_format` in their model YAML files and handle these in the Python code to pass the correct options to the backend API. The Xinfrence plugin would need similar updates: extend the model schema to accept these parameters, update the invocation logic to forward them to Xinference, and ensure the UI/config exposes these controls to users. You can use the Qwen or OpenRouter plugin implementations as a reference for both parameter handling and config structure [[OpenRouter example](https://github.com/langgenius/dify-official-plugins/pull/1192)] [[Tongyi/Qwen example](https://github.com/langgenius/dify-official-plugins/pull/1523)]. If you want to contribute, start by updating the Xinfrence plugin's model schema and invocation logic to support these parameters, then test with your private Xinference deployment. The open issue (#1854) is the right place to coordinate or discuss your approach. <!-- Dosu Comment Footer --> *To reply, just mention [@dosu](https://go.dosu.dev/dosubot).* --- <sup>How did I do? [Good](https://app.dosu.dev/response-feedback/c8a8b9b4-ac15-4fa0-b50f-54971e644d14?feedback_type=great_response) | [Irrelevant](https://app.dosu.dev/response-feedback/c8a8b9b4-ac15-4fa0-b50f-54971e644d14?feedback_type=irrelevant_answer) | [Incorrect](https://app.dosu.dev/response-feedback/c8a8b9b4-ac15-4fa0-b50f-54971e644d14?feedback_type=incorrect_sources) | [Verbose](https://app.dosu.dev/response-feedback/c8a8b9b4-ac15-4fa0-b50f-54971e644d14?feedback_type=too_verbose) | [Hallucination](https://app.dosu.dev/response-feedback/c8a8b9b4-ac15-4fa0-b50f-54971e644d14?feedback_type=hallucination) | [Report 🐛](https://app.dosu.dev/response-feedback/c8a8b9b4-ac15-4fa0-b50f-54971e644d14?feedback_type=bug_report) | [Other](https://app.dosu.dev/response-feedback/c8a8b9b4-ac15-4fa0-b50f-54971e644d14?feedback_type=other)</sup>&nbsp;&nbsp;[![Join Discord](https://img.shields.io/badge/join-5865F2?logo=discord&logoColor=white&label=)](https://go.dosu.dev/discord-bot)&nbsp;[![Share on X](https://img.shields.io/badge/X-share-black)](https://twitter.com/intent/tweet?text=%40dosu_ai%20helped%20me%20solve%20this%20issue!&url=https%3A//github.com/langgenius/dify-official-plugins/issues/1854)
yindo commented 2026-02-16 10:20:16 -05:00
Author
Owner
Copy Link
Copy Source

@simons19920101 commented on GitHub (Oct 14, 2025):

"I also added the Xinference qwen model. The model loads successfully, but when calling the model in the Dify application chat scenario, the plugin_daemon sends a stream: true request, Xinference returns an SSE response, but the Dify api service ultimately receives an empty answer."

Image
@simons19920101 commented on GitHub (Oct 14, 2025): "I also added the Xinference qwen model. The model loads successfully, but when calling the model in the Dify application chat scenario, the plugin_daemon sends a stream: true request, Xinference returns an SSE response, but the Dify api service ultimately receives an empty answer." <img width="1295" height="697" alt="Image" src="https://github.com/user-attachments/assets/de9a4c8f-e43b-407e-9709-98abcde8b9e3" />
yindo commented 2026-02-16 10:20:16 -05:00
Author
Owner
Copy Link
Copy Source

@dosubot[bot] commented on GitHub (Oct 30, 2025):

Hi, @bianningtao. I'm Dosu, and I'm helping the dify-official-plugins team manage their backlog and am marking this issue as stale.

Issue Summary:

  • You reported that Dify's Xinfrence plugin (v0.0.7) lacks model switch control and output format control features.
  • I confirmed these features are missing and shared guidance on how to add them by extending the model schema and invocation logic.
  • Another user encountered issues with streaming responses resulting in empty answers, indicating a potential SSE handling problem.
  • The issue remains open for contributions and further troubleshooting.

Next Steps:

  • Please let me know if this issue is still relevant with the latest version of the dify-official-plugins repository by commenting here.
  • If I don’t hear back within 5 days, I will automatically close this issue.

Thank you for your understanding and contribution!

@dosubot[bot] commented on GitHub (Oct 30, 2025): Hi, @bianningtao. I'm [Dosu](https://dosu.dev), and I'm helping the dify-official-plugins team manage their backlog and am marking this issue as stale. **Issue Summary:** - You reported that Dify's Xinfrence plugin (v0.0.7) lacks model switch control and output format control features. - I confirmed these features are missing and shared guidance on how to add them by extending the model schema and invocation logic. - Another user encountered issues with streaming responses resulting in empty answers, indicating a potential SSE handling problem. - The issue remains open for contributions and further troubleshooting. **Next Steps:** - Please let me know if this issue is still relevant with the latest version of the dify-official-plugins repository by commenting here. - If I don’t hear back within 5 days, I will automatically close this issue. Thank you for your understanding and contribution!
yindo commented 2026-02-16 10:20:16 -05:00
Author
Owner
Copy Link
Copy Source

@bianningtao commented on GitHub (Oct 30, 2025):

Yes, it still exists.

@bianningtao commented on GitHub (Oct 30, 2025): Yes, it still exists.
yindo commented 2026-02-16 10:20:16 -05:00
Author
Owner
Copy Link
Copy Source

@dosubot[bot] commented on GitHub (Nov 16, 2025):

Hi, @bianningtao. I'm Dosu, and I'm helping the dify-official-plugins team manage their backlog and am marking this issue as stale.

Issue Summary:

  • You reported that Dify's Xinfrence plugin (v0.0.7) lacks model switch control and output format control.
  • These features are supported by Xinference and other plugins like Qwen.
  • I provided guidance on how to add these features by extending the model schema and invocation logic.
  • A related streaming response issue was noted but remains unresolved.
  • You confirmed the problem still exists, and the issue remains open for contributions.

Next Steps:

  • Please let me know if this issue is still relevant with the latest version of the dify-official-plugins repository by commenting here.
  • If I do not hear back within 5 days, this issue will be automatically closed.

Thank you for your understanding and contribution!

@dosubot[bot] commented on GitHub (Nov 16, 2025): Hi, @bianningtao. I'm [Dosu](https://dosu.dev), and I'm helping the dify-official-plugins team manage their backlog and am marking this issue as stale. **Issue Summary:** - You reported that Dify's Xinfrence plugin (v0.0.7) lacks model switch control and output format control. - These features are supported by Xinference and other plugins like Qwen. - I provided guidance on how to add these features by extending the model schema and invocation logic. - A related streaming response issue was noted but remains unresolved. - You confirmed the problem still exists, and the issue remains open for contributions. **Next Steps:** - Please let me know if this issue is still relevant with the latest version of the dify-official-plugins repository by commenting here. - If I do not hear back within 5 days, this issue will be automatically closed. Thank you for your understanding and contribution!
yindo commented 2026-02-16 10:20:16 -05:00
Author
Owner
Copy Link
Copy Source

@bianningtao commented on GitHub (Nov 19, 2025):

still exists

@bianningtao commented on GitHub (Nov 19, 2025): still exists
yindo commented 2026-02-16 10:20:16 -05:00
Author
Owner
Copy Link
Copy Source

@dosubot[bot] commented on GitHub (Dec 5, 2025):

Hi, @bianningtao. I'm Dosu, and I'm helping the dify-official-plugins team manage their backlog and am marking this issue as stale.

Issue Summary:

  • You reported that Dify's Xinfrence plugin (v0.0.7) lacks model switch control and output format control features.
  • These features exist in Xinference and other plugins like Qwen.
  • I provided guidance on extending the model schema and invocation logic to add these features.
  • A related streaming response issue causing empty answers was also noted.
  • Despite reminders, you confirmed the issue still persists and no resolution has been implemented yet.

Next Steps:

  • Please let me know if this issue is still relevant with the latest version of the dify-official-plugins repository by commenting here.
  • If I do not hear back within 5 days, this issue will be automatically closed.

Thank you for your understanding and contribution!

@dosubot[bot] commented on GitHub (Dec 5, 2025): Hi, @bianningtao. I'm [Dosu](https://dosu.dev), and I'm helping the dify-official-plugins team manage their backlog and am marking this issue as stale. **Issue Summary:** - You reported that Dify's Xinfrence plugin (v0.0.7) lacks model switch control and output format control features. - These features exist in Xinference and other plugins like Qwen. - I provided guidance on extending the model schema and invocation logic to add these features. - A related streaming response issue causing empty answers was also noted. - Despite reminders, you confirmed the issue still persists and no resolution has been implemented yet. **Next Steps:** - Please let me know if this issue is still relevant with the latest version of the dify-official-plugins repository by commenting here. - If I do not hear back within 5 days, this issue will be automatically closed. Thank you for your understanding and contribution!
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
bug
bug
dependencies
documentation
enhancement
good first issue
invalid
pull-request
Mirrored from GitHub Pull Request
 question
stale
No Label enhancement
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify-official-plugins#710
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?