[GH-ISSUE #2543] [BUG]: Skipping document - Token limit of 128000 has already been exceeded by pinned documents #1647

Closed
opened 2026-02-22 18:25:52 -05:00 by yindo · 1 comment
Owner

Originally created by @kabaluyot on GitHub (Oct 28, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2543

How are you running AnythingLLM?

Docker (remote machine)

What happened?

What does this "info log" means?

For context, it is a gpt4o-mini model wit 950 pdfs uploaded as knowledge source.

Screen Shot 2024-10-28 at 12 34 17 PM

Are there known steps to reproduce?

No response

Originally created by @kabaluyot on GitHub (Oct 28, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2543 ### How are you running AnythingLLM? Docker (remote machine) ### What happened? What does this "info log" means? For context, it is a gpt4o-mini model wit 950 pdfs uploaded as knowledge source. <img width="1070" alt="Screen Shot 2024-10-28 at 12 34 17 PM" src="https://github.com/user-attachments/assets/ce17f523-fff2-437f-bf7f-920fc9294430"> ### Are there known steps to reproduce? _No response_
yindo added the possible bug label 2026-02-22 18:25:52 -05:00
yindo closed this issue 2026-02-22 18:25:52 -05:00
Author
Owner

@timothycarambat commented on GitHub (Oct 28, 2024):

gpt4o-mini has a max context window of 128K tokens. You pinned more than 128K tokens so our system prunes them out of the context because your request would fail. This is likely because you attaching 980 PDFs, the model's context window is not infinite

@timothycarambat commented on GitHub (Oct 28, 2024): `gpt4o-mini` has a max context window of 128K tokens. You pinned more than 128K tokens so our system prunes them out of the context because your request would fail. This is likely because you attaching 980 PDFs, the model's context window is not infinite
yindo changed title from [BUG]: Skipping document - Token limit of 128000 has already been exceeded by pinned documents to [GH-ISSUE #2543] [BUG]: Skipping document - Token limit of 128000 has already been exceeded by pinned documents 2026-06-05 14:41:55 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#1647