[GH-ISSUE #258] Clarify built-in LLM functionality. #208

Open
opened 2026-06-05 15:22:14 -04:00 by yindo · 0 comments
Owner

Originally created by @timothycarambat on GitHub (May 28, 2026).
Original GitHub issue: https://github.com/Mintplex-Labs/anythingllm-docs/issues/258

Thank you for the detailed response — that clears things up!

One small suggestion: it might be worth adding a brief note in the official docs clarifying that the built-in AnythingLLM provider is just Ollama's MIT-licensed engine intended for running local GGUFs, and is not a full Ollama replacement. Specifically mentioning that Ollama cloud models are not an intentionally supported feature through the built-in provider could save future users a lot of confusion.

I went down quite a rabbit hole trying to figure out why cloud models accidentally worked through the built-in provider — and the answer wasn't findable anywhere online. A single line in the docs would have saved that entire investigation 😅

Thanks again for taking the time to respond.

Originally posted by @aestheticdoodle in #5715

Originally created by @timothycarambat on GitHub (May 28, 2026). Original GitHub issue: https://github.com/Mintplex-Labs/anythingllm-docs/issues/258 > Thank you for the detailed response — that clears things up! > > One small suggestion: it might be worth adding a brief note in the official docs clarifying that the built-in AnythingLLM provider is just Ollama's MIT-licensed engine intended for running local GGUFs, and is not a full Ollama replacement. Specifically mentioning that Ollama cloud models are not an intentionally supported feature through the built-in provider could save future users a lot of confusion. > > I went down quite a rabbit hole trying to figure out why cloud models accidentally worked through the built-in provider — and the answer wasn't findable anywhere online. A single line in the docs would have saved that entire investigation 😅 > > Thanks again for taking the time to respond. _Originally posted by @aestheticdoodle in [#5715](https://github.com/Mintplex-Labs/anything-llm/issues/5715#issuecomment-4560893084)_
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anythingllm-docs#208