[GH-ISSUE #5676] [BUG]: Non-Ollama Agent Providers Do Not Parse and Present Reasoning Content #5232

Open
opened 2026-06-05 14:52:48 -04:00 by yindo · 0 comments
Owner

Originally created by @angelplusultra on GitHub (May 21, 2026).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/5676

Originally assigned to: @angelplusultra on GitHub.

How are you running AnythingLLM?

Docker (local)

What happened?

Any agent provider besides Ollama does not parse and present a reasoning models visible CoT.

Are there known steps to reproduce?

  1. Setup a non Ollama provider such as LM Studio.
  2. Use a reasoning model that outputs it's CoT (e.g gemma4).
  3. Prompt the model in agent mode or using @agent and notice no CoT is being outputted for the user to read.

LLM Provider & Model (if applicable)

Any Agent Provider that is not Ollama

Embedder Provider & Model (if applicable)

No response

Originally created by @angelplusultra on GitHub (May 21, 2026). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/5676 Originally assigned to: @angelplusultra on GitHub. ### How are you running AnythingLLM? Docker (local) ### What happened? Any agent provider besides Ollama does not parse and present a reasoning models visible CoT. ### Are there known steps to reproduce? 1. Setup a non Ollama provider such as LM Studio. 2. Use a reasoning model that outputs it's CoT (e.g `gemma4`). 3. Prompt the model in agent mode or using `@agent` and notice no CoT is being outputted for the user to read. ### LLM Provider & Model (if applicable) Any Agent Provider that is not Ollama ### Embedder Provider & Model (if applicable) _No response_
yindo added the possible bugcore-team-only labels 2026-06-05 14:52:48 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#5232