[GH-ISSUE #970] [FEAT]: Custom Context Window Per Chat #593

Open
opened 2026-02-22 18:20:22 -05:00 by yindo · 0 comments
Owner

Originally created by @lukemauldinks on GitHub (Mar 25, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/970

What would you like to see?

Running AnythingLLM desktop app on Ubuntu 22.04 with ollama as a backend running locally. I have multiple models - deepseek-coder, mistral, openchat - and each model has its own workspace. I would like to be able to set the workspace using the deepseek-coder model a context window 16K while leaving openchat only supports 8K context window.
I only see one location in the AnythingLLM UI to set context window and it is in the LLM Preference selection screen.

Originally created by @lukemauldinks on GitHub (Mar 25, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/970 ### What would you like to see? Running AnythingLLM desktop app on Ubuntu 22.04 with ollama as a backend running locally. I have multiple models - deepseek-coder, mistral, openchat - and each model has its own workspace. I would like to be able to set the workspace using the deepseek-coder model a context window 16K while leaving openchat only supports 8K context window. I only see one location in the AnythingLLM UI to set context window and it is in the LLM Preference selection screen.
yindo added the enhancementfeature request labels 2026-02-22 18:20:22 -05:00
yindo changed title from [FEAT]: Custom Context Window Per Chat to [GH-ISSUE #970] [FEAT]: Custom Context Window Per Chat 2026-06-05 14:36:11 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#593