[GH-ISSUE #1207] [BUG]: RAG and Embeddings #745

Closed
opened 2026-02-22 18:21:09 -05:00 by yindo · 1 comment
Owner

Originally created by @stanribilir on GitHub (Apr 27, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/1207

How are you running AnythingLLM?

AnythingLLM desktop app

What happened?

Hello. i've tested a pdf file with 69 pages many times with different embedding models. built-in model seems to be pretty fast but unfortunately i can not get what i ask for. it even doesn't retrieve page number for specific tag names, simple operation just like search. is there any improvement area for the built-in embedding model? (i also used built-in vectordb. another thing is i've also tried to test with ollama nomic embedding using ollama server ip, that took longer time but it's even worse output performance than the builtin in my case)

Are there known steps to reproduce?

No response

Originally created by @stanribilir on GitHub (Apr 27, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/1207 ### How are you running AnythingLLM? AnythingLLM desktop app ### What happened? Hello. i've tested a pdf file with 69 pages many times with different embedding models. built-in model seems to be pretty fast but unfortunately i can not get what i ask for. it even doesn't retrieve page number for specific tag names, simple operation just like search. is there any improvement area for the built-in embedding model? (i also used built-in vectordb. another thing is i've also tried to test with ollama nomic embedding using ollama server ip, that took longer time but it's even worse output performance than the builtin in my case) ### Are there known steps to reproduce? _No response_
yindo added the possible bug label 2026-02-22 18:21:09 -05:00
yindo closed this issue 2026-02-22 18:21:09 -05:00
Author
Owner

@timothycarambat commented on GitHub (Apr 27, 2024):

This may help explain why that is the result. Given the length of your documents, even more so. Also could be work trying to ask a question via the @agent invocation. https://docs.useanything.com/faq/why-is-llm-not-using-docs. There is always room to improve rag but that is not really what this issue is going for as it seems more informational

@timothycarambat commented on GitHub (Apr 27, 2024): This may help explain why that is the result. Given the length of your documents, even more so. Also could be work trying to ask a question via the `@agent` invocation. https://docs.useanything.com/faq/why-is-llm-not-using-docs. There is always room to improve rag but that is not really what this issue is going for as it seems more informational
yindo changed title from [BUG]: RAG and Embeddings to [GH-ISSUE #1207] [BUG]: RAG and Embeddings 2026-06-05 14:36:58 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#745