[GH-ISSUE #1975] [FEAT]: list documents with pagination #1281

Closed
opened 2026-02-22 18:24:04 -05:00 by yindo · 1 comment
Owner

Originally created by @johnnychen94 on GitHub (Jul 26, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/1975

What would you like to see?

I've successfully uploaded the entire knowledge base (> 7000 files) using the API endpoint programmatically.
This immediately introduces a performance issue that /v1/documents fails to return the result in a reasonable time.

<html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx/1.20.1</center>
</body>
</html>

Another similar situation is the document workspace fails to show the result and keeps the loading ring almost forever:

image

The chat and RAG part still works.

This is a request for pagination support so that workspaces with too many documents still work well.

For what it worths, our current workaround is to merge eagerly the 8000 files into a few big files (e.g., concatenate them until reaches 50M limit) so that we don't reach this too-many-files problem.

Originally created by @johnnychen94 on GitHub (Jul 26, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/1975 ### What would you like to see? I've successfully uploaded the entire knowledge base (> 7000 files) using the API endpoint programmatically. This immediately introduces a performance issue that `/v1/documents` fails to return the result in a reasonable time. ``` <html> <head><title>504 Gateway Time-out</title></head> <body> <center><h1>504 Gateway Time-out</h1></center> <hr><center>nginx/1.20.1</center> </body> </html> ``` Another similar situation is the document workspace fails to show the result and keeps the loading ring almost forever: <img width="1322" alt="image" src="https://github.com/user-attachments/assets/4f521f12-a51c-47b3-bf96-3ff621177b44"> The chat and RAG part still works. This is a request for pagination support so that workspaces with too many documents still work well. For what it worths, our current workaround is to merge eagerly the 8000 files into a few big files (e.g., concatenate them until reaches 50M limit) so that we don't reach this too-many-files problem.
yindo added the enhancementfeature request labels 2026-02-22 18:24:04 -05:00
yindo closed this issue 2026-02-22 18:24:04 -05:00
Author
Owner

@timothycarambat commented on GitHub (Sep 19, 2024):

Moved to #2317

@timothycarambat commented on GitHub (Sep 19, 2024): Moved to #2317
yindo changed title from [FEAT]: list documents with pagination to [GH-ISSUE #1975] [FEAT]: list documents with pagination 2026-06-05 14:39:55 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#1281