Custom model not support function calling in Agent Mode? #8109

Closed
opened 2026-02-21 18:23:58 -05:00 by yindo · 4 comments
Owner

Originally created by @k99k5 on GitHub (Feb 10, 2025).

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

Dify version

0.15.3

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

Image
Image

✔️ Expected Behavior

Image

Actual Behavior

Image

Originally created by @k99k5 on GitHub (Feb 10, 2025). ### Self Checks - [x] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [x] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [x] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:) - [x] Please do not modify this template :) and fill in all the required fields. ### Dify version 0.15.3 ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce ![Image](https://github.com/user-attachments/assets/947f7884-a53e-4f5c-a6a5-a8a063af8f08) ![Image](https://github.com/user-attachments/assets/b848ed6c-e273-4439-82a8-babf12488633) ### ✔️ Expected Behavior ![Image](https://github.com/user-attachments/assets/19b9f230-399f-4f33-9292-6ff5b75e0972) ### ❌ Actual Behavior ![Image](https://github.com/user-attachments/assets/01ede7b9-dac4-4e3b-8c40-8a3662da78f2)
yindo added the 🐞 bugstale labels 2026-02-21 18:23:58 -05:00
yindo closed this issue 2026-02-21 18:23:58 -05:00
Author
Owner

@dosubot[bot] commented on GitHub (Feb 10, 2025):

Hello, @k99k5! I'm here to help you with any bugs, questions, or contributions you may have. Let's work together to resolve your issue.

To ensure that a custom model supports 'Function Calling' in Agent Mode, you need to verify a few key configurations:

  1. Agent Node Configuration: Make sure that the Agent node in your workflow is set to use the 'Function Calling' strategy. This can be done in the node configuration panel by selecting 'Function Calling' from the Agent Strategy dropdown menu [1].

  2. Model Compatibility: Ensure that the model you are using supports 'Function Calling'. Models like GPT-3.5 and GPT-4 are known to support this feature effectively [2].

  3. Model Settings: Check the model settings to confirm that 'Function Calling' is enabled. This includes ensuring that the necessary parameters, such as API keys and tool configurations, are correctly set up [2].

  4. Tool Integration: Verify that the tools required for function calling are properly integrated and configured. This includes providing API keys and setting tool descriptions and parameters [1].

If these configurations are correctly set and the issue persists, it might be helpful to review the model's documentation or settings to ensure all necessary features are enabled.

To continue talking to Dosu, mention @dosu.


Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Other

@dosubot[bot] commented on GitHub (Feb 10, 2025): <!-- Greeting --> Hello, @k99k5! I'm here to help you with any bugs, questions, or contributions you may have. Let's work together to resolve your issue. <!-- Answer --> To ensure that a custom model supports 'Function Calling' in Agent Mode, you need to verify a few key configurations: 1. **Agent Node Configuration**: Make sure that the Agent node in your workflow is set to use the 'Function Calling' strategy. This can be done in the node configuration panel by selecting 'Function Calling' from the Agent Strategy dropdown menu <sup>[[1]](https://github.com/langgenius/dify-docs/blob/main/en/guides/workflow/node/agent.md)</sup>. 2. **Model Compatibility**: Ensure that the model you are using supports 'Function Calling'. Models like GPT-3.5 and GPT-4 are known to support this feature effectively <sup>[[2]](https://github.com/langgenius/dify-docs/issues/433)</sup>. 3. **Model Settings**: Check the model settings to confirm that 'Function Calling' is enabled. This includes ensuring that the necessary parameters, such as API keys and tool configurations, are correctly set up <sup>[[2]](https://github.com/langgenius/dify-docs/issues/433)</sup>. 4. **Tool Integration**: Verify that the tools required for function calling are properly integrated and configured. This includes providing API keys and setting tool descriptions and parameters <sup>[[1]](https://github.com/langgenius/dify-docs/blob/main/en/guides/workflow/node/agent.md)</sup>. If these configurations are correctly set and the issue persists, it might be helpful to review the model's documentation or settings to ensure all necessary features are enabled. <!-- Dosu Comment Footer --> *To continue talking to [Dosu](https://dosu.dev), mention @dosu.* --- <sup>Help Dosu learn! Give it feedback: [Great Response](https://app.dosu.dev/response-feedback/6a9d321c-6840-455f-8884-cbf75226d865?feedback_type=great_response) | [Irrelevant Answer](https://app.dosu.dev/response-feedback/6a9d321c-6840-455f-8884-cbf75226d865?feedback_type=irrelevant_answer) | [Incorrect Sources](https://app.dosu.dev/response-feedback/6a9d321c-6840-455f-8884-cbf75226d865?feedback_type=incorrect_sources) | [Too Verbose](https://app.dosu.dev/response-feedback/6a9d321c-6840-455f-8884-cbf75226d865?feedback_type=too_verbose) | [Hallucination](https://app.dosu.dev/response-feedback/6a9d321c-6840-455f-8884-cbf75226d865?feedback_type=hallucination) | [Other](https://app.dosu.dev/response-feedback/6a9d321c-6840-455f-8884-cbf75226d865?feedback_type=other)</sup>
Author
Owner

@crazywoola commented on GitHub (Feb 10, 2025):

Afaik, enable the function call will disrupt the display of thinking content. So current, this is an expected behavior.

@crazywoola commented on GitHub (Feb 10, 2025): Afaik, enable the function call will disrupt the display of thinking content. So current, this is an expected behavior.
Author
Owner

@k99k5 commented on GitHub (Feb 10, 2025):

Afaik, enable the function call will disrupt the display of thinking content. So current, this is an expected behavior.

@crazywoola 内置的是可以的,但是没pro,自己加pro上去就不行了。v3只是普通模型,硅基那边pro的话是带加速的
Image
Image

@k99k5 commented on GitHub (Feb 10, 2025): > Afaik, enable the function call will disrupt the display of thinking content. So current, this is an expected behavior. @crazywoola 内置的是可以的,但是没pro,自己加pro上去就不行了。v3只是普通模型,硅基那边pro的话是带加速的 ![Image](https://github.com/user-attachments/assets/e332dcca-e6ff-4900-968e-d8fdfa1b5f91) ![Image](https://github.com/user-attachments/assets/03e98863-973e-4873-900c-578594284b28)
Author
Owner

@dosubot[bot] commented on GitHub (Mar 13, 2025):

Hi, @k99k5. I'm Dosu, and I'm helping the Dify team manage their backlog. I'm marking this issue as stale.

Issue Summary:

  • You reported a bug in Dify version 0.15.3 with custom models not supporting function calling in Agent Mode when self-hosted via Docker.
  • I suggested checking configurations related to agent node settings, model compatibility, and tool integration.
  • Crazywoola noted that enabling function calls might disrupt the display of thinking content, which is expected.
  • You confirmed the issue persists with custom models, especially when adding pro features, and provided images for clarity.

Next Steps:

  • Could you please confirm if this issue is still relevant with the latest version of Dify? If so, feel free to comment to keep the discussion open.
  • If there is no further activity, this issue will be automatically closed in 15 days.

Thank you for your understanding and contribution!

@dosubot[bot] commented on GitHub (Mar 13, 2025): Hi, @k99k5. I'm [Dosu](https://dosu.dev), and I'm helping the Dify team manage their backlog. I'm marking this issue as stale. **Issue Summary:** - You reported a bug in Dify version 0.15.3 with custom models not supporting function calling in Agent Mode when self-hosted via Docker. - I suggested checking configurations related to agent node settings, model compatibility, and tool integration. - Crazywoola noted that enabling function calls might disrupt the display of thinking content, which is expected. - You confirmed the issue persists with custom models, especially when adding pro features, and provided images for clarity. **Next Steps:** - Could you please confirm if this issue is still relevant with the latest version of Dify? If so, feel free to comment to keep the discussion open. - If there is no further activity, this issue will be automatically closed in 15 days. Thank you for your understanding and contribution!
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#8109