The Ollama model cannot be streamed in MCP #601

Closed
opened 2026-02-16 10:19:52 -05:00 by yindo · 1 comment
Owner

Originally created by @ssl7828 on GitHub (Aug 28, 2025).

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues Dify issues & Dify Official Plugins, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

Dify version

1.7.1

Plugin version

0.0.7

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

When I select Ollama's model in the mcp agent node, here I choose the on-premises Qwen3-32b, and find that the ai output is not streamed, but waits for a large section to be returned in the end, and if I switch to the model of a third-party service provider, I can stream the output.

✔️ Error log

No response

Originally created by @ssl7828 on GitHub (Aug 28, 2025). ### Self Checks - [x] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [x] I have searched for existing issues [Dify issues](https://github.com/langgenius/dify/issues) & [Dify Official Plugins](https://github.com/langgenius/dify-official-plugins/issues), including closed ones. - [x] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:) - [x] Please do not modify this template :) and fill in all the required fields. ### Dify version 1.7.1 ### Plugin version 0.0.7 ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce When I select Ollama's model in the mcp agent node, here I choose the on-premises Qwen3-32b, and find that the ai output is not streamed, but waits for a large section to be returned in the end, and if I switch to the model of a third-party service provider, I can stream the output. ### ✔️ Error log _No response_
yindo added the bug label 2026-02-16 10:19:52 -05:00
yindo closed this issue 2026-02-16 10:19:52 -05:00
Author
Owner

@dosubot[bot] commented on GitHub (Aug 28, 2025):

This is a known limitation: the Ollama plugin does not support streaming output in agent nodes (MCP) in Dify, even in recent versions. Responses are only returned after the full answer is ready, not incrementally streamed. Streaming works with some third-party providers and in other application types like Chatflow, but not with Ollama in agent workflows. This is due to the lack of support for the "stream-tool-call" feature in the Ollama plugin and the way agent nodes handle tool calls and ReAct mode. There is a planned feature to add streaming support for agent nodes in a future Dify release, but it's not available yet for Ollama models. For streaming output in agent nodes, you need to use supported models like Tongyi (Qwen-max) and select Function Calling mode instead of ReAct see details more info.

To reply, just mention @dosu.


How did I do? Good | Irrelevant | Incorrect | Verbose | Hallucination | Report 🐛 | Other  Join Discord Share on X

@dosubot[bot] commented on GitHub (Aug 28, 2025): <!-- Answer --> This is a known limitation: the Ollama plugin does not support streaming output in agent nodes (MCP) in Dify, even in recent versions. Responses are only returned after the full answer is ready, not incrementally streamed. Streaming works with some third-party providers and in other application types like Chatflow, but not with Ollama in agent workflows. This is due to the lack of support for the "stream-tool-call" feature in the Ollama plugin and the way agent nodes handle tool calls and ReAct mode. There is a planned feature to add streaming support for agent nodes in a future Dify release, but it's not available yet for Ollama models. For streaming output in agent nodes, you need to use supported models like Tongyi (Qwen-max) and select Function Calling mode instead of ReAct [see details](https://github.com/langgenius/dify-official-plugins/issues/1126) [more info](https://github.com/langgenius/dify/issues/20952). <!-- Dosu Comment Footer --> *To reply, just mention [@dosu](https://go.dosu.dev/dosubot).* --- <sup>How did I do? [Good](https://app.dosu.dev/response-feedback/3d345529-5734-45d7-9d89-023b2816a89a?feedback_type=great_response) | [Irrelevant](https://app.dosu.dev/response-feedback/3d345529-5734-45d7-9d89-023b2816a89a?feedback_type=irrelevant_answer) | [Incorrect](https://app.dosu.dev/response-feedback/3d345529-5734-45d7-9d89-023b2816a89a?feedback_type=incorrect_sources) | [Verbose](https://app.dosu.dev/response-feedback/3d345529-5734-45d7-9d89-023b2816a89a?feedback_type=too_verbose) | [Hallucination](https://app.dosu.dev/response-feedback/3d345529-5734-45d7-9d89-023b2816a89a?feedback_type=hallucination) | [Report 🐛](https://app.dosu.dev/response-feedback/3d345529-5734-45d7-9d89-023b2816a89a?feedback_type=bug_report) | [Other](https://app.dosu.dev/response-feedback/3d345529-5734-45d7-9d89-023b2816a89a?feedback_type=other)</sup>&nbsp;&nbsp;[![Join Discord](https://img.shields.io/badge/join-5865F2?logo=discord&logoColor=white&label=)](https://go.dosu.dev/discord-bot)&nbsp;[![Share on X](https://img.shields.io/badge/X-share-black)](https://twitter.com/intent/tweet?text=%40dosu_ai%20helped%20me%20solve%20this%20issue!&url=https%3A//github.com/langgenius/dify-official-plugins/issues/1610)
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify-official-plugins#601