[GH-ISSUE #4085] [FEAT]: Support dockerized MCP servers in dockerized AnythingLLM #2603

Closed
opened 2026-02-22 18:30:25 -05:00 by yindo · 3 comments
Owner

Originally created by @L5driver on GitHub (Jul 1, 2025).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/4085

How are you running AnythingLLM?

Docker (remote machine)

What happened?

Added the mcp/time to anythingllm_mcp_servers.json

{
  "mcpServers": {
    "time": {
      "command": "docker",
      "args": [
        "run",
        "-i",
        "--rm",
        "mcp/time"
      ]
    }
  }
}

But Agent Skills page indicates "STOPPED" state and an error Failed to start MCP server: time [ENOENT] spawn docker ENOENT

Are there known steps to reproduce?

Clean docker compose:

services:
  anythingllm:
    container_name: anythingllm
    image: mintplexlabs/anythingllm:latest
    ports:
      - 3001:3001
    volumes:
      - /share/anythingllm/storage:/app/server/storage
    cap_add:
      - SYS_ADMIN
    environment:
      - STORAGE_DIR=/app/server/storage
      - COMMUNITY_HUB_BUNDLE_DOWNLOADS_ENABLED="1"
      - VECTOR_DB=lancedb
      - PASSWORDMINCHAT=8
    extra_hosts:
      - host.docker.internal:host-gateway
    restart: unless-stopped

using ollama for LLM

Originally created by @L5driver on GitHub (Jul 1, 2025). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/4085 ### How are you running AnythingLLM? Docker (remote machine) ### What happened? Added the mcp/time to anythingllm_mcp_servers.json ``` { "mcpServers": { "time": { "command": "docker", "args": [ "run", "-i", "--rm", "mcp/time" ] } } } ``` But Agent Skills page indicates "STOPPED" state and an error `Failed to start MCP server: time [ENOENT] spawn docker ENOENT` ### Are there known steps to reproduce? Clean docker compose: ``` services: anythingllm: container_name: anythingllm image: mintplexlabs/anythingllm:latest ports: - 3001:3001 volumes: - /share/anythingllm/storage:/app/server/storage cap_add: - SYS_ADMIN environment: - STORAGE_DIR=/app/server/storage - COMMUNITY_HUB_BUNDLE_DOWNLOADS_ENABLED="1" - VECTOR_DB=lancedb - PASSWORDMINCHAT=8 extra_hosts: - host.docker.internal:host-gateway restart: unless-stopped ``` using ollama for LLM
yindo added the feature request label 2026-02-22 18:30:25 -05:00
yindo closed this issue 2026-02-22 18:30:25 -05:00
Author
Owner

@shatfield4 commented on GitHub (Jul 1, 2025):

Unfortunately, at this current time, using this MCP server while running the docker version of AnythingLLM will not work. This is because we do not have access to the docker command inside of a running docker container unless docker in docker is setup (which can get extremely complex).

I would suggest you check out the Desktop version of AnythingLLM and it should be compatible there (just make sure you have docker desktop running when refreshing the MCP servers).

This is something we may explore in the future since it seems like lots of MCP servers are moving to dockerized containers for ease of setup and compartmentalization.

@shatfield4 commented on GitHub (Jul 1, 2025): Unfortunately, at this current time, using this MCP server while running the docker version of AnythingLLM will not work. This is because we do not have access to the `docker` command inside of a running docker container unless docker in docker is setup (which can get extremely complex). I would suggest you check out the Desktop version of AnythingLLM and it should be compatible there (just make sure you have docker desktop running when refreshing the MCP servers). This is something we may explore in the future since it seems like lots of MCP servers are moving to dockerized containers for ease of setup and compartmentalization.
Author
Owner

@timothycarambat commented on GitHub (Jul 1, 2025):

This is documented in https://docs.anythingllm.com/mcp-compatibility/docker#command-availability

Additionally, you can always do a post-start container command to apt get install -y docker or whatever cli tooling you would like so it exists without having to modify the base image

@timothycarambat commented on GitHub (Jul 1, 2025): This is documented in https://docs.anythingllm.com/mcp-compatibility/docker#command-availability Additionally, you can always do a post-start container command to `apt get install -y docker` or whatever cli tooling you would like so it exists without having to modify the base image
Author
Owner

@L5driver commented on GitHub (Jul 1, 2025):

Understood @shatfield4. @timothycarambat that sounds like a plan, thanks for the tip.

Update: I tried adding

post_start:
  - command: apt get install -y docker

but which docker still shows not installed. I'm thinking its a permission issue I need to resolve.

@L5driver commented on GitHub (Jul 1, 2025): Understood @shatfield4. @timothycarambat that sounds like a plan, thanks for the tip. --- Update: I tried adding ``` post_start: - command: apt get install -y docker ``` but `which docker` still shows not installed. I'm thinking its a permission issue I need to resolve.
yindo changed title from [FEAT]: Support dockerized MCP servers in dockerized AnythingLLM to [GH-ISSUE #4085] [FEAT]: Support dockerized MCP servers in dockerized AnythingLLM 2026-06-05 14:47:29 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#2603