[GH-ISSUE #3472] [BUG]: Document upload works 1 out of 10 times #2242

Closed
opened 2026-02-22 18:28:48 -05:00 by yindo · 1 comment
Owner

Originally created by @Kwisss on GitHub (Mar 15, 2025).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/3472

How are you running AnythingLLM?

AnythingLLM desktop app

What happened?

Document upload works, then it does not.
it's a lottery if the model sees (all) the attached documents,
I do not know what is happening, no errors show up

Are there known steps to reproduce?

  1. add documents
  2. pin them
  3. talk to the llm
  4. see if you are in luck
Originally created by @Kwisss on GitHub (Mar 15, 2025). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/3472 ### How are you running AnythingLLM? AnythingLLM desktop app ### What happened? Document upload works, then it does not. it's a lottery if the model sees (all) the attached documents, I do not know what is happening, no errors show up ### Are there known steps to reproduce? 1. add documents 2. pin them 3. talk to the llm 4. see if you are in luck
yindo added the possible bug label 2026-02-22 18:28:48 -05:00
yindo closed this issue 2026-02-22 18:28:48 -05:00
Author
Owner

@timothycarambat commented on GitHub (Mar 17, 2025):

You are probably pinning all your documents and then trying to send 10K of context into a model that you specified or set a context window that is far lower.

If you send more context than a model can handle, it will crash the LLM and/or fail since that is going to basically OOM error. You cannot just infinitely send context into an LLM locally and expect it to handle more than it is trained on or what you machine resources can handle.

@timothycarambat commented on GitHub (Mar 17, 2025): You are probably pinning all your documents and then trying to send 10K of context into a model that you specified or set a context window that is far lower. If you send more context than a model can handle, it will crash the LLM and/or fail since that is going to basically OOM error. You cannot just infinitely send context into an LLM locally and expect it to handle more than it is trained on _or_ what you machine resources can handle.
yindo changed title from [BUG]: Document upload works 1 out of 10 times to [GH-ISSUE #3472] [BUG]: Document upload works 1 out of 10 times 2026-06-05 14:45:24 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#2242