Mintplex-Labs/anything-llm
1
0
Fork 0
mirror of https://github.com/Mintplex-Labs/anything-llm.git synced 2026-07-19 14:13:35 -04:00
Code Issues 328 Packages Projects Releases 10 Wiki Activity

[GH-ISSUE #2548] [unable loading ollama with dokcer anythingllm ]: can't loading the local Ollama with docker anything #1650

New Issue
Closed
opened 2026-02-22 18:25:53 -05:00 by yindo · 3 comments
yindo commented 2026-02-22 18:25:53 -05:00
Owner
Copy Link
Copy Source

Originally created by @ddimit2020 on GitHub (Oct 28, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2548

How are you running AnythingLLM?

Docker (local)

What happened?

I'm also follow the step to install docker anything

  1. docker pull mintplexlabs/anythingllm
  2. export STORAGE_LOCATION=$HOME/anythingllm &&
    mkdir -p $STORAGE_LOCATION &&
    touch "$STORAGE_LOCATION/.env"

docker run -d -p 3001:3001
--add-host=host.docker.internal:host-gateway
--cap-add SYS_ADMIN
-v ${STORAGE_LOCATION}:/app/server/storage
-v ${STORAGE_LOCATION}/.env:/app/server/.env
-e STORAGE_DIR="/app/server/storage"
mintplexlabs/anythingllm

3.also vim /etc/systemd/system/ollama.service
[Service] add 2 Env.
Environment="OLLAMA_HOST=0.0.0.0:11434"
Environment="OLLAMA_MODELS=/www/algorithm/LLM_model/models"

  1. after restart
    systemctl daemon-reload
    systemctl restart ollama

5.than setup the anythingllm,can;t load the localhost:ollama
anythingllm

also i already try URL:http://host.docker.internal:11434,still can't loading the ollama model

shoud i miss something step?

os:Ubuntu 20.04.6
ollama install the ubuntu localhost:11434
Docker version 24.0.7
anythingllm install the docker

have anything idea???

Are there known steps to reproduce?

No response

Originally created by @ddimit2020 on GitHub (Oct 28, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2548 ### How are you running AnythingLLM? Docker (local) ### What happened? I'm also follow the step to install docker anything 1. **docker pull mintplexlabs/anythingllm** 2. export STORAGE_LOCATION=$HOME/anythingllm && \ mkdir -p $STORAGE_LOCATION && \ touch "$STORAGE_LOCATION/.env" docker run -d -p 3001:3001 \ --add-host=host.docker.internal:host-gateway \ --cap-add SYS_ADMIN \ -v ${STORAGE_LOCATION}:/app/server/storage \ -v ${STORAGE_LOCATION}/.env:/app/server/.env \ -e STORAGE_DIR="/app/server/storage" \ mintplexlabs/anythingllm 3.also vim /etc/systemd/system/ollama.service [Service] add 2 Env. Environment="OLLAMA_HOST=0.0.0.0:11434" Environment="OLLAMA_MODELS=/www/algorithm/LLM_model/models" 4. after restart systemctl daemon-reload systemctl restart ollama 5.than setup the anythingllm,can;t load the localhost:ollama ![anythingllm](https://github.com/user-attachments/assets/353c9ce3-ae3c-44e1-8c14-ffbdce31728b) also i already try URL:http://host.docker.internal:11434,still can't loading the ollama model shoud i miss something step? os:Ubuntu 20.04.6 ollama install the ubuntu localhost:11434 Docker version 24.0.7 anythingllm install the docker have anything idea??? ### Are there known steps to reproduce? _No response_
yindo added the possible bug label 2026-02-22 18:25:53 -05:00
yindo closed this issue 2026-02-22 18:25:53 -05:00
yindo commented 2026-02-22 18:25:53 -05:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (Oct 29, 2024):

Are you able to even reach the ollama API via the http://192.168.58.164:11434 URL in a browser?
http://192.168.58.164:11434/api/tags should return a JSON response with all installed models.

If the browser cannot resolve the that location, then the container certainly cannot.

@timothycarambat commented on GitHub (Oct 29, 2024): Are you able to even reach the ollama API via the `http://192.168.58.164:11434` URL in a browser? http://192.168.58.164:11434/api/tags should return a JSON response with all installed models. If the browser cannot resolve the that location, then the container certainly cannot.
yindo commented 2026-02-22 18:25:53 -05:00
Author
Owner
Copy Link
Copy Source

@ddimit2020 commented on GitHub (Oct 29, 2024):

before your tips,actually i still can't open http://192.168.58.164:11434 and http://192.168.58.164:11434/api/tags,
after i modify /etc/hosts & ufw disable,now can access & add ollama_host=192.168.58.164 ollama serve http://192.168.58.164:11434 and http://192.168.58.164:11434/api/tags,
but also can't loading the ollama model,
have any idea,i so confuse

the docker logs and ollama logs
docker_logs

the browser still can't loading the ollama Model
web

but the ollama have the Model
ollama

browser ollama running
running

browser ollama api(with not open the ubuntu server browser)
api-tags

but in the ubuntu(ollama service and docker install anythingllm) can show the api/tags
ubuntu

also i will try curl -i http://192.168.58.164:11434/api/tags & curl -i http://localhost:11434/api/tags
i think it's issue point,localhost can reach the Ollama model,but use the IP can't
but still don't have idea to solved
api-tags-2

=========================Final==========
i restore the original os and install the ollama,also reach
http://192.168.58.164:11434 or http://localhost:11434 --->show the ollama running
http://192.168.58.164:11434/api/tags or http://ocalhost:11434/api/tags--->show the json Models,
than install the docker with anythinhllm,hope the well done~
just ing now~~~~

@ddimit2020 commented on GitHub (Oct 29, 2024): before your tips,actually i still can't open http://192.168.58.164:11434 and http://192.168.58.164:11434/api/tags, after i modify /etc/hosts & ufw disable,now can access & add ollama_host=192.168.58.164 ollama serve http://192.168.58.164:11434 and http://192.168.58.164:11434/api/tags, but also can't loading the ollama model, have any idea,i so confuse the docker logs and ollama logs ![docker_logs](https://github.com/user-attachments/assets/a911e44b-182e-475c-b3f8-0a239b7b061b) the browser still can't loading the ollama Model ![web](https://github.com/user-attachments/assets/bac303d9-9e2e-4abe-8b7e-426f17f2e5ff) but the ollama have the Model ![ollama](https://github.com/user-attachments/assets/be729798-d8ee-40ba-9e34-583971f91ee9) browser ollama running ![running](https://github.com/user-attachments/assets/83f843bb-35e7-4cc8-888d-bb473a9da803) browser ollama api(with not open the ubuntu server browser) ![api-tags](https://github.com/user-attachments/assets/b56170fa-d701-4625-8c45-b7ba1ee0cce5) but in the ubuntu(ollama service and docker install anythingllm) can show the api/tags ![ubuntu](https://github.com/user-attachments/assets/368af770-69e2-453c-b774-7e32ab1a47bd) also i will try curl -i http://192.168.58.164:11434/api/tags & curl -i http://localhost:11434/api/tags i think it's issue point,localhost can reach the Ollama model,but use the IP can't but still don't have idea to solved ![api-tags-2](https://github.com/user-attachments/assets/ad18034f-9aef-4dd4-a7f3-e199dfddadb0) =========================Final========== i restore the original os and install the ollama,also reach http://192.168.58.164:11434 or http://localhost:11434 --->show the ollama running http://192.168.58.164:11434/api/tags or http://ocalhost:11434/api/tags--->show the json Models, than install the docker with anythinhllm,hope the well done~ just ing now~~~~
yindo commented 2026-02-22 18:25:53 -05:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (Oct 30, 2024):

I overlooked this prior, but host.docker.internal does not work on Ubuntu
https://docs.anythingllm.com/ollama-connection-troubleshooting#url-detection-failed-when-manual-endpoint-input-is-expanded-the-url-was-not
On "Docker" tab

Docker Version
Windows/macOS: http://host.docker.internal:11434
Linux: http://172.17.0.1:11434
On Linux, use http://172.17.0.1:11434 as host.docker.internal doesn't work.

Have you tried http://172.17.0.1:11434 in the URL? This maps localhost in the container to the host, which now since localhost works - this should too.

@timothycarambat commented on GitHub (Oct 30, 2024): I overlooked this prior, but host.docker.internal **does not work on Ubuntu** https://docs.anythingllm.com/ollama-connection-troubleshooting#url-detection-failed-when-manual-endpoint-input-is-expanded-the-url-was-not On "Docker" tab ``` Docker Version Windows/macOS: http://host.docker.internal:11434 Linux: http://172.17.0.1:11434 On Linux, use http://172.17.0.1:11434 as host.docker.internal doesn't work. ``` Have you tried http://172.17.0.1:11434 in the URL? This maps localhost in the container to the host, which now since localhost works - this should too.
yindo changed title from [unable loading ollama with dokcer anythingllm ]: can't loading the local Ollama with docker anything to [GH-ISSUE #2548] [unable loading ollama with dokcer anythingllm ]: can't loading the local Ollama with docker anything 2026-06-05 14:41:56 -04:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Desktop
Docker
Integration Request
Integration Request
OS: Linux
OS: Mobile
OS: Windows
UI/UX
blocked
bug
bug
core-team-only
documentation
duplicate
embed-widget
enhancement
feature request
github_actions
good first issue
investigating
needs info / can't replicate
possible bug
pull-request
Mirrored from GitHub Pull Request
 question
stage: specifications
wontfix
No Label possible bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#1650
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?