[GH-ISSUE #1605] Is there a limit to the content length of the application's ability to crawl the site? Is the crawling content accurate and comprehensive? Because I need to extract the information from the text accurately and that's very important #1044

Closed
opened 2026-02-22 18:22:51 -05:00 by yindo · 1 comment
Owner

Originally created by @mingLvft on GitHub (Jun 4, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/1605

What would you like to see?

Is there a limit to the content length of the application's ability to crawl the site? Is the crawling content accurate and comprehensive? Because I need to extract the information from the text accurately and that's very important

Originally created by @mingLvft on GitHub (Jun 4, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/1605 ### What would you like to see? Is there a limit to the content length of the application's ability to crawl the site? Is the crawling content accurate and comprehensive? Because I need to extract the information from the text accurately and that's very important
yindo added the enhancementfeature request labels 2026-02-22 18:22:51 -05:00
yindo closed this issue 2026-02-22 18:22:51 -05:00
Author
Owner

@timothycarambat commented on GitHub (Jun 4, 2024):

There is no "limit" per se, it is dictated by your LLM's context window. RAG is not perfect and no system has 100% recall even if you put the entire document into the context window there is no guarantee that any LLM will not hallucinate information.

@timothycarambat commented on GitHub (Jun 4, 2024): There is no "limit" per se, it is dictated by your LLM's context window. RAG is not perfect and no system has 100% recall even if you put the entire document into the context window there is no guarantee that any LLM will not hallucinate information.
yindo changed title from Is there a limit to the content length of the application's ability to crawl the site? Is the crawling content accurate and comprehensive? Because I need to extract the information from the text accurately and that's very important to [GH-ISSUE #1605] Is there a limit to the content length of the application's ability to crawl the site? Is the crawling content accurate and comprehensive? Because I need to extract the information from the text accurately and that's very important 2026-06-05 14:38:40 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#1044