Why can't the agent tool in the workflow choose a local large model, and can only select online large models? #16194

Closed
opened 2026-02-21 19:25:02 -05:00 by yindo · 2 comments
Owner

Originally created by @zhongjidalao on GitHub (Aug 15, 2025).

Self Checks

  • I have read the Contributing Guide and Language Policy.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report, otherwise it will be closed.
  • Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

Image

2. Additional context or comments

No response

3. Can you help us with this feature?

  • I am interested in contributing to this feature.
Originally created by @zhongjidalao on GitHub (Aug 15, 2025). ### Self Checks - [x] I have read the [Contributing Guide](https://github.com/langgenius/dify/blob/main/CONTRIBUTING.md) and [Language Policy](https://github.com/langgenius/dify/issues/1542). - [x] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [x] I confirm that I am using English to submit this report, otherwise it will be closed. - [x] Please do not modify this template :) and fill in all the required fields. ### 1. Is this request related to a challenge you're experiencing? Tell me about your story. <img width="889" height="666" alt="Image" src="https://github.com/user-attachments/assets/fd79ff16-dbb0-4edc-9852-ae41d1b0f0cb" /> ### 2. Additional context or comments _No response_ ### 3. Can you help us with this feature? - [ ] I am interested in contributing to this feature.
yindo added the 🙋‍♂️ question label 2026-02-21 19:25:02 -05:00
yindo closed this issue 2026-02-21 19:25:02 -05:00
Author
Owner

@dosubot[bot] commented on GitHub (Aug 15, 2025):

The agent tool in Dify workflows can only select certain models because it filters for models that are compatible with agent strategies—specifically, those that support "function call" or "ReACT" methods. Most local models, even if registered via OpenAI-compatible plugins, won't appear in the agent tool selection unless they meet these requirements. The backend logic and UI are designed to only show models from providers that guarantee consistent API interaction, which usually means online models. This is a known limitation and is frequently reported by users who want to use local models in agent workflows. Full support for arbitrary local models in agent strategies is not yet implemented as of v1.7.1. If your local model supports function calling, double-check your plugin configuration and try refreshing the page after adding new models—sometimes they don't appear in the dropdown until you do so. For more details and troubleshooting tips, see this discussion and this related issue.

To reply, just mention @dosu.


How did I do? Good | Irrelevant | Incorrect | Verbose | Hallucination | Report 🐛 | Other  Chat with Dosu Join Discord Share on X

@dosubot[bot] commented on GitHub (Aug 15, 2025): <!-- Answer --> The agent tool in Dify workflows can only select certain models because it filters for models that are compatible with agent strategies—specifically, those that support "function call" or "ReACT" methods. Most local models, even if registered via OpenAI-compatible plugins, won't appear in the agent tool selection unless they meet these requirements. The backend logic and UI are designed to only show models from providers that guarantee consistent API interaction, which usually means online models. This is a known limitation and is frequently reported by users who want to use local models in agent workflows. Full support for arbitrary local models in agent strategies is not yet implemented as of v1.7.1. If your local model supports function calling, double-check your plugin configuration and try refreshing the page after adding new models—sometimes they don't appear in the dropdown until you do so. For more details and troubleshooting tips, see [this discussion](https://github.com/langgenius/dify/issues/23230#issuecomment-3139206855) and [this related issue](https://github.com/langgenius/dify/issues/23417). <!-- Dosu Comment Footer --> *To reply, just mention [@dosu](https://go.dosu.dev/dosubot).* --- <sup>How did I do? [Good](https://app.dosu.dev/response-feedback/063ec47b-f1de-4031-9b5f-ac4a5090d034?feedback_type=great_response) | [Irrelevant](https://app.dosu.dev/response-feedback/063ec47b-f1de-4031-9b5f-ac4a5090d034?feedback_type=irrelevant_answer) | [Incorrect](https://app.dosu.dev/response-feedback/063ec47b-f1de-4031-9b5f-ac4a5090d034?feedback_type=incorrect_sources) | [Verbose](https://app.dosu.dev/response-feedback/063ec47b-f1de-4031-9b5f-ac4a5090d034?feedback_type=too_verbose) | [Hallucination](https://app.dosu.dev/response-feedback/063ec47b-f1de-4031-9b5f-ac4a5090d034?feedback_type=hallucination) | [Report 🐛](https://app.dosu.dev/response-feedback/063ec47b-f1de-4031-9b5f-ac4a5090d034?feedback_type=bug_report) | [Other](https://app.dosu.dev/response-feedback/063ec47b-f1de-4031-9b5f-ac4a5090d034?feedback_type=other)</sup>&nbsp;&nbsp;[![Chat with Dosu](https://dosu.dev/dosu-chat-badge.svg)](https://app.dosu.dev/6088a4f4-073a-43f3-b3d4-4f06fb0c05a0/ask?utm_source=github)&nbsp;[![Join Discord](https://img.shields.io/badge/join-5865F2?logo=discord&logoColor=white&label=)](https://go.dosu.dev/discord-bot)&nbsp;[![Share on X](https://img.shields.io/badge/X-share-black)](https://twitter.com/intent/tweet?text=%40dosu_ai%20helped%20me%20solve%20this%20issue!&url=https%3A//github.com/langgenius/dify/issues/23997)
Author
Owner

@crazywoola commented on GitHub (Aug 15, 2025):

See the bot's reply.

@crazywoola commented on GitHub (Aug 15, 2025): See the bot's reply.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#16194