[GH-ISSUE #3632] [BUG]: Ollama - custom LLM with makefile have SYSTEM cleared out #2344

Closed
opened 2026-02-22 18:29:16 -05:00 by yindo · 1 comment
Owner

Originally created by @kafej on GitHub (Apr 11, 2025).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/3632

How are you running AnythingLLM?

Docker (local)

What happened?

Hi,

I would like to know if this is a bug, but custom made LLM on Ollama side have their SYSTEM variable cleared out when used on ANythingLLM.

Are there known steps to reproduce?

No response

Originally created by @kafej on GitHub (Apr 11, 2025). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/3632 ### How are you running AnythingLLM? Docker (local) ### What happened? Hi, I would like to know if this is a bug, but custom made LLM on Ollama side have their SYSTEM variable cleared out when used on ANythingLLM. ### Are there known steps to reproduce? _No response_
yindo added the possible bug label 2026-02-22 18:29:16 -05:00
yindo closed this issue 2026-02-22 18:29:16 -05:00
Author
Owner

@timothycarambat commented on GitHub (Apr 11, 2025):

Because we pass in a system prompt via API always (which you can modify in workspace settings) - this overwrites the default in a Modelfile you may have set.

@timothycarambat commented on GitHub (Apr 11, 2025): Because we pass in a system prompt via API always (which you can modify in workspace settings) - this overwrites the default in a Modelfile you may have set.
yindo changed title from [BUG]: Ollama - custom LLM with makefile have SYSTEM cleared out to [GH-ISSUE #3632] [BUG]: Ollama - custom LLM with makefile have SYSTEM cleared out 2026-06-05 14:46:01 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#2344