[GH-ISSUE #2064] [FEAT]: RAG In-Text Citations like Perplexity #1342

Closed
opened 2026-02-22 18:24:21 -05:00 by yindo · 1 comment
Owner

Originally created by @cw7github on GitHub (Aug 7, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2064

What would you like to see?

I know that AnythingLLM already has citations for RAG, but I think having in-text citations like Perplexity would be a big improvement. I think this will be essential for RAG applications going forward, since if you pull in 10+ different chunks for each RAG message, the user doesn't want to have to look through each of those chunks in order to verify if each of the statements in the response make sense. Being able to just hover over each citation at the end of each statement from the LLM would be a game-changer (Google's NotebookLM does this for example).

Here's a reddit thread where they talk about how to implement this:
https://www.reddit.com/r/LocalLLaMA/comments/1e5emhi/want_to_understand_how_citations_of_sources_work/?utm_source=share&utm_medium=web3x&utm_name=web3xcss&utm_term=1&utm_content=share_button

Here's a description of this feature that's been implemented in deepset:
https://docs.cloud.deepset.ai/docs/referencepredictor

Originally created by @cw7github on GitHub (Aug 7, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2064 ### What would you like to see? I know that AnythingLLM already has citations for RAG, but I think having in-text citations like Perplexity would be a big improvement. I think this will be essential for RAG applications going forward, since if you pull in 10+ different chunks for each RAG message, the user doesn't want to have to look through each of those chunks in order to verify if each of the statements in the response make sense. Being able to just hover over each citation at the end of each statement from the LLM would be a game-changer (Google's NotebookLM does this for example). Here's a reddit thread where they talk about how to implement this: https://www.reddit.com/r/LocalLLaMA/comments/1e5emhi/want_to_understand_how_citations_of_sources_work/?utm_source=share&utm_medium=web3x&utm_name=web3xcss&utm_term=1&utm_content=share_button Here's a description of this feature that's been implemented in deepset: https://docs.cloud.deepset.ai/docs/referencepredictor
yindo added the enhancementfeature request labels 2026-02-22 18:24:21 -05:00
yindo closed this issue 2026-02-22 18:24:21 -05:00
Author
Owner

@timothycarambat commented on GitHub (Jan 3, 2025):

Moved to #2827

@timothycarambat commented on GitHub (Jan 3, 2025): Moved to #2827
yindo changed title from [FEAT]: RAG In-Text Citations like Perplexity to [GH-ISSUE #2064] [FEAT]: RAG In-Text Citations like Perplexity 2026-06-05 14:40:15 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#1342