Using the model in xinference, calling the tool-supported model reports an error. #242

Closed
opened 2026-02-16 10:18:34 -05:00 by yindo · 0 comments
Owner

Originally created by @suntao2015005848 on GitHub (Apr 30, 2025).

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

Dify version

1.3.1

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

My xinference model is Qwen2.5-32B-Instruct with tool-calling capability enabled. It works fine when called via OpenAI's API,
Image
but after adding the Qwen2.5-32B-Instruct model in Dify and attempting to invoke the configured tool, the following error occurs:
[xinference] Error: PluginInvokeError: {"args":{"description":"[models] Error: name 'helper' is not defined"},"error_type":"InvokeError","message":"[models] Error: name 'helper' is not defined"}

✔️ Expected Behavior

Image

Actual Behavior

Image

Originally created by @suntao2015005848 on GitHub (Apr 30, 2025). ### Self Checks - [x] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [x] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [x] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:) - [x] Please do not modify this template :) and fill in all the required fields. ### Dify version 1.3.1 ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce My xinference model is Qwen2.5-32B-Instruct with tool-calling capability enabled. It works fine when called via OpenAI's API, <img width="1333" alt="Image" src="https://github.com/user-attachments/assets/c8b64315-09da-43ed-bca0-272f7c344103" /> but after adding the Qwen2.5-32B-Instruct model in Dify and attempting to invoke the configured tool, the following error occurs: [xinference] Error: PluginInvokeError: {"args":{"description":"[models] Error: name 'helper' is not defined"},"error_type":"InvokeError","message":"[models] Error: name 'helper' is not defined"} ### ✔️ Expected Behavior ![Image](https://github.com/user-attachments/assets/9cfa5f0b-02b3-4043-8df9-8350af00c8ed) ### ❌ Actual Behavior ![Image](https://github.com/user-attachments/assets/c3fb28fe-c694-4f5d-90db-8ca6d67ecb4b)
yindo closed this issue 2026-02-16 10:18:34 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify-official-plugins#242