[GH-ISSUE #3823] [BUG]: MCP server is not called during chat request #2447

Closed
opened 2026-02-22 18:29:43 -05:00 by yindo · 3 comments
Owner

Originally created by @rallepalle on GitHub (May 14, 2025).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/3823

How are you running AnythingLLM?

AnythingLLM desktop app

What happened?

I have registered a mcp mongo server in AnythingLLM Desktop. This is started correctly (see Agent Skills -> Mongo MCP Server). All tools are displayed correctly.
However, for a specific chat request (e.g. list all collections) the mcp service is not called and taken into account. Unfortunately, there is also no information about this in the log files.
However, the request works locally with a separate LLM client or with Claude Desktop.

Are there known steps to reproduce?

No response

Originally created by @rallepalle on GitHub (May 14, 2025). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/3823 ### How are you running AnythingLLM? AnythingLLM desktop app ### What happened? I have registered a mcp mongo server in AnythingLLM Desktop. This is started correctly (see Agent Skills -> Mongo MCP Server). All tools are displayed correctly. However, for a specific chat request (e.g. list all collections) the mcp service is not called and taken into account. Unfortunately, there is also no information about this in the log files. However, the request works locally with a separate LLM client or with Claude Desktop. ### Are there known steps to reproduce? _No response_
yindo added the possible bug label 2026-02-22 18:29:43 -05:00
yindo closed this issue 2026-02-22 18:29:43 -05:00
Author
Owner

@timothycarambat commented on GitHub (May 14, 2025):

https://docs.anythingllm.com/agent-not-using-tools#llm-says-it-cannot-call-xyz-tool

This is the model presumably if you are running a local model. Claude is a super massive model that runs on GPUs worth the price of a house. A local model (esp not running on a GPU) will be "dumber" than a massive cloud model and will therefore not call tools

@timothycarambat commented on GitHub (May 14, 2025): https://docs.anythingllm.com/agent-not-using-tools#llm-says-it-cannot-call-xyz-tool This is the _model_ presumably if you are running a local model. Claude is a super massive model that runs on GPUs worth the price of a house. A local model (esp not running on a GPU) will be "dumber" than a massive cloud model and will therefore not call tools
Author
Owner

@rallepalle commented on GitHub (May 14, 2025):

@timothycarambat Thanks for the answer, but that can't be the problem. I am using Azure OpenAi and not a local model !

@rallepalle commented on GitHub (May 14, 2025): @timothycarambat Thanks for the answer, but that can't be the problem. I am using Azure OpenAi and not a local model !
Author
Owner

@timothycarambat commented on GitHub (May 14, 2025):

If you open the desktop logs do you see a bunch of MCP tools being loaded when calling @agent <prompt>?
https://docs.anythingllm.com/installation-desktop/debug#general-debugging

@timothycarambat commented on GitHub (May 14, 2025): If you open the desktop logs do you see a bunch of MCP tools being loaded when calling `@agent <prompt>`? https://docs.anythingllm.com/installation-desktop/debug#general-debugging
yindo changed title from [BUG]: MCP server is not called during chat request to [GH-ISSUE #3823] [BUG]: MCP server is not called during chat request 2026-06-05 14:46:36 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#2447