Mintplex-Labs/anything-llm
1
0
Fork 0
mirror of https://github.com/Mintplex-Labs/anything-llm.git synced 2026-07-19 14:13:35 -04:00
Code Issues 328 Packages Projects Releases 10 Wiki Activity

[GH-ISSUE #4371] [BUG]: Failed To Fetch all models on TrueNAS SCALE #2786

New Issue
Closed
opened 2026-02-22 18:31:15 -05:00 by yindo · 6 comments
yindo commented 2026-02-22 18:31:15 -05:00
Owner
Copy Link
Copy Source

Originally created by @Gizmo564 on GitHub (Sep 9, 2025).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/4371

How are you running AnythingLLM?

Docker (remote machine)

What happened?

I installed AnythingLLM on my TrueNAS SCALE server alongside Ollama to use in tandem, however upon attempting onboarding every time I try to link them it fails to save the settings and says failed to fetch. I have tried using OpenAI's API as well and the same thing happens. I do not know how to solve this problem, and can't find any resources that explain how to.

Are there known steps to reproduce?

No response

Originally created by @Gizmo564 on GitHub (Sep 9, 2025). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/4371 ### How are you running AnythingLLM? Docker (remote machine) ### What happened? I installed AnythingLLM on my TrueNAS SCALE server alongside Ollama to use in tandem, however upon attempting onboarding every time I try to link them it fails to save the settings and says failed to fetch. I have tried using OpenAI's API as well and the same thing happens. I do not know how to solve this problem, and can't find any resources that explain how to. ### Are there known steps to reproduce? _No response_
yindo added the possible bug label 2026-02-22 18:31:15 -05:00
yindo closed this issue 2026-02-22 18:31:15 -05:00
yindo commented 2026-02-22 18:31:15 -05:00
Author
Owner
Copy Link
Copy Source

@DE4DLY commented on GitHub (Sep 9, 2025):

I am facing the same issue here, but with LMStudio. Adding the local machine with the LMStudio Server and Models ends up in a Failed to save LLM settings: "Failed to fetch" error. The models appear, but cannot go any further than this step in the initial setup.

@DE4DLY commented on GitHub (Sep 9, 2025): I am facing the same issue here, but with LMStudio. Adding the local machine with the LMStudio Server and Models ends up in a Failed to save LLM settings: "Failed to fetch" error. The models appear, but cannot go any further than this step in the initial setup.
yindo commented 2026-02-22 18:31:15 -05:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (Sep 12, 2025):

I installed AnythingLLM on my TrueNAS SCALE server alongside Ollama to use in tandem

How are you doing this? Every single time, this is because the person set up the networking or the web-server proxy incorrectly, or it is just not configured correctly. More information about your deployment would help as that is where you issue is.

@timothycarambat commented on GitHub (Sep 12, 2025): > I installed AnythingLLM on my TrueNAS SCALE server alongside Ollama to use in tandem How are you doing this? Every single time, this is because the person set up the networking or the web-server proxy incorrectly, or it is just not configured correctly. More information about your deployment would help as that is where you issue is.
yindo commented 2026-02-22 18:31:15 -05:00
Author
Owner
Copy Link
Copy Source

@Gizmo564 commented on GitHub (Sep 12, 2025):

I installed it via the TrueNAS SCALE apps manager, I filled out the secrets and bound it to my host network. It now automatically identifies the Ollama instance but fails to fetch the models from it. What other details do you need? It's exposed to the network and is running open on localhost and 0.0.0.0 (Every exposed ip, with the proper port). Permissions are excited, its on port 30239.

@Gizmo564 commented on GitHub (Sep 12, 2025): I installed it via the TrueNAS SCALE apps manager, I filled out the secrets and bound it to my host network. It now automatically identifies the Ollama instance but fails to fetch the models from it. What other details do you need? It's exposed to the network and is running open on localhost and 0.0.0.0 (Every exposed ip, with the proper port). Permissions are excited, its on port 30239.
yindo commented 2026-02-22 18:31:15 -05:00
Author
Owner
Copy Link
Copy Source

@Gizmo564 commented on GitHub (Sep 15, 2025):

@timothycarambat Is there any more information you need in order to help?

@Gizmo564 commented on GitHub (Sep 15, 2025): @timothycarambat Is there any more information you need in order to help?
yindo commented 2026-02-22 18:31:15 -05:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (Sep 16, 2025):

but now automatically identifies the Ollama instance but fails to fetch the models from it.

Assuming the ollama instance has models pulled, it should be reachable, but keep in mind that the AnythingLLM Docker container cannot use the local loopback (or 0.0.0.0). You need to use http://host.docker.internal or http://172.17.0.1 on Ubuntu instead: https://docs.anythingllm.com/ollama-connection-troubleshooting#localhost-and-127001-do-not-work-on-docker

I am assuming AnythingLLM is running in Docker, Ollama on the host, Ollama serving on 0.0.0.0. By the way, you dont need Ollama on 0.0.0.0, you can move it back to 127.0.0.1 so it is not reachable on LAN outside of the NAS

@timothycarambat commented on GitHub (Sep 16, 2025): > but now automatically identifies the Ollama instance but fails to fetch the models from it. Assuming the ollama instance has models pulled, it should be reachable, but keep in mind that the AnythingLLM Docker container cannot use the local loopback (or 0.0.0.0). You need to use `http://host.docker.internal` or `http://172.17.0.1` on Ubuntu instead: https://docs.anythingllm.com/ollama-connection-troubleshooting#localhost-and-127001-do-not-work-on-docker I am assuming AnythingLLM is running in Docker, Ollama on the host, Ollama serving on 0.0.0.0. By the way, you dont need Ollama on 0.0.0.0, you can move it back to 127.0.0.1 so it is not reachable on LAN outside of the NAS
yindo commented 2026-02-22 18:31:15 -05:00
Author
Owner
Copy Link
Copy Source

@Gizmo564 commented on GitHub (Sep 16, 2025):

Both Docker and Ollama are running in a Kubernetes Docker environment. I have tried host.docker.internal and 172.17.0.1. Neither have worked.

@Gizmo564 commented on GitHub (Sep 16, 2025): Both Docker and Ollama are running in a Kubernetes Docker environment. I have tried host.docker.internal and 172.17.0.1. Neither have worked.
yindo changed title from [BUG]: Failed To Fetch all models on TrueNAS SCALE to [GH-ISSUE #4371] [BUG]: Failed To Fetch all models on TrueNAS SCALE 2026-06-05 14:48:33 -04:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Desktop
Docker
Integration Request
Integration Request
OS: Linux
OS: Mobile
OS: Windows
UI/UX
blocked
bug
bug
core-team-only
documentation
duplicate
embed-widget
enhancement
feature request
github_actions
good first issue
investigating
needs info / can't replicate
possible bug
pull-request
Mirrored from GitHub Pull Request
 question
stage: specifications
wontfix
No Label possible bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#2786
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?