[GH-ISSUE #1133] [BUG]: AnythingLLM can not find ollama embedding models #700

Closed
opened 2026-02-22 18:20:54 -05:00 by yindo · 1 comment
Owner

Originally created by @vgjm on GitHub (Apr 19, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/1133

How are you running AnythingLLM?

AnythingLLM desktop app

What happened?

I'm tring to use AnythingLLM with ollama but it can not find the embedders.
I have pulled two embedding models by ollama:

❯ ollama list
NAME                            ID              SIZE    MODIFIED
llama2:latest                   78e26419b446    3.8 GB  6 days ago
llama3:latest                   71a106a91016    4.7 GB  2 hours ago
mistral:latest                  61e88e884507    4.1 GB  6 days ago
mxbai-embed-large:latest        468836162de7    669 MB  6 days ago
nomic-embed-text:latest         0a109f422b47    274 MB  11 minutes ago

My ollama is running and AnythingLLM can select llama3/llama2 of ollama as LLM Provider.
屏幕截图(9)

But when it comes to embedding provider, it stucks at loading available models.
屏幕截图(10)

Are there known steps to reproduce?

No response

Originally created by @vgjm on GitHub (Apr 19, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/1133 ### How are you running AnythingLLM? AnythingLLM desktop app ### What happened? I'm tring to use AnythingLLM with ollama but it can not find the embedders. I have pulled two embedding models by ollama: ``` ❯ ollama list NAME ID SIZE MODIFIED llama2:latest 78e26419b446 3.8 GB 6 days ago llama3:latest 71a106a91016 4.7 GB 2 hours ago mistral:latest 61e88e884507 4.1 GB 6 days ago mxbai-embed-large:latest 468836162de7 669 MB 6 days ago nomic-embed-text:latest 0a109f422b47 274 MB 11 minutes ago ``` My ollama is running and AnythingLLM can select llama3/llama2 of ollama as LLM Provider. ![屏幕截图(9)](https://github.com/Mintplex-Labs/anything-llm/assets/88078088/75c4d375-9597-478b-bb6d-3c2bb7df5929) But when it comes to embedding provider, it stucks at loading available models. ![屏幕截图(10)](https://github.com/Mintplex-Labs/anything-llm/assets/88078088/7c7c5d49-eb41-45d3-b3a0-3e62090326dc) ### Are there known steps to reproduce? _No response_
yindo added the possible bug label 2026-02-22 18:20:54 -05:00
yindo closed this issue 2026-02-22 18:20:54 -05:00
Author
Owner

@vgjm commented on GitHub (Apr 19, 2024):

I just started another ollama service by ollama serve with a new port and the problem seems to be solved.
After I selected the nomic model on the new port, I can switch back to the default port of ollama and close the temporary service I just started.
Now everything is OK.

I will close this issue.
Just share some information if anybody has the same problem.

@vgjm commented on GitHub (Apr 19, 2024): I just started another ollama service by `ollama serve` with a new port and the problem seems to be solved. After I selected the nomic model on the new port, I can switch back to the default port of ollama and close the temporary service I just started. Now everything is OK. I will close this issue. Just share some information if anybody has the same problem.
yindo changed title from [BUG]: AnythingLLM can not find ollama embedding models to [GH-ISSUE #1133] [BUG]: AnythingLLM can not find ollama embedding models 2026-06-05 14:36:44 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#700