Mintplex-Labs/anything-llm
1
0
Fork 0
mirror of https://github.com/Mintplex-Labs/anything-llm.git synced 2026-07-21 01:25:28 -04:00
Code Issues 328 Packages Projects Releases 10 Wiki Activity

[GH-ISSUE #4658] [FEAT]: Control on Contex Lenght #2956

New Issue
Closed
opened 2026-02-22 18:32:01 -05:00 by yindo · 2 comments
yindo commented 2026-02-22 18:32:01 -05:00
Owner
Copy Link
Copy Source

Originally created by @ProfRino on GitHub (Nov 18, 2025).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/4658

What would you like to see?

Hello team
I am speding time learning this beautful tool. Thanks for creating it!
I am wondering if there is any option to cotrol the context lenght of my local model like I do with Open WebUI.

Currently AnythingLLM is connected to my Ollama model but I am not sure which context lenght I am using

Thanks
Rino

Originally created by @ProfRino on GitHub (Nov 18, 2025). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/4658 ### What would you like to see? Hello team I am speding time learning this beautful tool. Thanks for creating it! I am wondering if there is any option to cotrol the context lenght of my local model like I do with Open WebUI. Currently AnythingLLM is connected to my Ollama model but I am not sure which context lenght I am using Thanks Rino
yindo added the enhancementfeature request labels 2026-02-22 18:32:01 -05:00
yindo closed this issue 2026-02-22 18:32:01 -05:00
yindo commented 2026-02-22 18:32:02 -05:00
Author
Owner
Copy Link
Copy Source

@shatfield4 commented on GitHub (Nov 18, 2025):

We are automatically grabbing the context length from Ollama so that you can use the entire context of the model. What use case do you have for controlling context length?

If you just want to see the context window that you are using then you can upload a file via the paperclip icon here and hover on it to see the context size like this:

Image
@shatfield4 commented on GitHub (Nov 18, 2025): We are automatically grabbing the context length from Ollama so that you can use the entire context of the model. What use case do you have for controlling context length? If you just want to see the context window that you are using then you can upload a file via the paperclip icon here and hover on it to see the context size like this: <img width="406" height="165" alt="Image" src="https://github.com/user-attachments/assets/2d10d1b6-1541-4ac3-8bae-deffc5a0a29e" />
yindo commented 2026-02-22 18:32:02 -05:00
Author
Owner
Copy Link
Copy Source

@ProfRino commented on GitHub (Nov 18, 2025):

Thanks for the prompt answer!

I am trying to create my custom model with a defined context length (num_ctx).
Controlling the context length is critical to how much we can feed the model, and having better-performing RAGs
Try to have a RAG with the minimum context lengths and with much more memory. More space, more info, you can use to have an answer that makes sense. Same for agentic tasks

In my AI classes, I explain that the two most important parameters to control are temperature and context length (num_ctx).
https://www.youtube.com/watch?v=EQFGS4kfoT8

Feel free to prove me wrong as I am here to learn too :)
Cheers
Rino

@ProfRino commented on GitHub (Nov 18, 2025): Thanks for the prompt answer! I am trying to create my custom model with a defined context length (num_ctx). Controlling the context length is critical to how much we can feed the model, and having better-performing RAGs Try to have a RAG with the minimum context lengths and with much more memory. More space, more info, you can use to have an answer that makes sense. Same for agentic tasks In my AI classes, I explain that the two most important parameters to control are temperature and context length (num_ctx). https://www.youtube.com/watch?v=EQFGS4kfoT8 Feel free to prove me wrong as I am here to learn too :) Cheers Rino
yindo changed title from [FEAT]: Control on Contex Lenght to [GH-ISSUE #4658] [FEAT]: Control on Contex Lenght 2026-06-05 14:49:29 -04:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Desktop
Docker
Integration Request
Integration Request
OS: Linux
OS: Mobile
OS: Windows
UI/UX
blocked
bug
bug
core-team-only
documentation
duplicate
embed-widget
enhancement
feature request
github_actions
good first issue
investigating
needs info / can't replicate
possible bug
pull-request
Mirrored from GitHub Pull Request
 question
stage: specifications
wontfix
No Label enhancement feature request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#2956
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?