[GH-ISSUE #3147] [BUG]: Embedded Chat Widget - not considering Query mode option. Always working in Chat mode. #2020

Closed
opened 2026-02-22 18:27:47 -05:00 by yindo · 1 comment
Owner

Originally created by @varadasrini on GitHub (Feb 7, 2025).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/3147

Originally assigned to: @shatfield4 on GitHub.

How are you running AnythingLLM?

Docker (local)

What happened?

What happened?
Description
There appears to be a discrepancy in the responses generated by AnythingLLM when interacting through its frontend (chat widget) versus using its Workspace interfaces. Specifically, the Chat widget seems to disregard pinned documents and possibly the Retrieval-Augmented Generation (RAG) workflow, leading to inconsistencies in behavior and response content.

Observed Behavior
Frontend (Workspace):
Pinned Documents are working perfectly when using the workspace and considering the content from documents.
The RAG workflow is followed, producing relevant and coherent answers that align with the intended setup.
Chat Widget:
Responses differ significantly from those generated by the frontend.
Pinned documents and embedded information do not appear to be factored into the responses.
It seems as though the RAG process is either bypassed.

Expected Behavior
Consistent behavior and responses across both the AnythingLLM frontend and its Chatbot based on the configurations should work.
Seems always the Chat Mode is selected irrespective of Query mode selection at Workspace level or Embeded Code level.

Are there known steps to reproduce?

Uploaded the documents and pinned them.

Workspace is configured with mode as Query mode to consider only the documents. And it RAG system works.

Creating new Embed Chat Widget from same workspace and no changes in setting. Chat Widget suppose to work based on the Chat mode setup. But always works in Chat Mode only irrespective query mode.

Please advise on this issue

Originally created by @varadasrini on GitHub (Feb 7, 2025). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/3147 Originally assigned to: @shatfield4 on GitHub. ### How are you running AnythingLLM? Docker (local) ### What happened? What happened? Description There appears to be a discrepancy in the responses generated by AnythingLLM when interacting through its frontend (chat widget) versus using its Workspace interfaces. Specifically, the Chat widget seems to disregard pinned documents and possibly the Retrieval-Augmented Generation (RAG) workflow, leading to inconsistencies in behavior and response content. Observed Behavior Frontend (Workspace): Pinned Documents are working perfectly when using the workspace and considering the content from documents. The RAG workflow is followed, producing relevant and coherent answers that align with the intended setup. Chat Widget: Responses differ significantly from those generated by the frontend. Pinned documents and embedded information do not appear to be factored into the responses. It seems as though the RAG process is either bypassed. Expected Behavior Consistent behavior and responses across both the AnythingLLM frontend and its Chatbot based on the configurations should work. Seems always the Chat Mode is selected irrespective of Query mode selection at Workspace level or Embeded Code level. ### Are there known steps to reproduce? Uploaded the documents and pinned them. Workspace is configured with mode as Query mode to consider only the documents. And it RAG system works. Creating new Embed Chat Widget from same workspace and no changes in setting. Chat Widget suppose to work based on the Chat mode setup. But always works in Chat Mode only irrespective query mode. Please advise on this issue
yindo added the Dockerpossible buginvestigating labels 2026-02-22 18:27:47 -05:00
yindo closed this issue 2026-02-22 18:27:47 -05:00
Author
Owner

@shatfield4 commented on GitHub (Feb 10, 2025):

I am unable to replicate this and everything is working as expected when I tested it just now. Are you able to provide me with some documents and some example of how you are able to replicate this? It may be just an issue with the model responding differently each time rather than the RAG/pinned documents not working. Closing for now, but feel free to provide more examples and I will reopen the issue if we are able to replicate this.

@shatfield4 commented on GitHub (Feb 10, 2025): I am unable to replicate this and everything is working as expected when I tested it just now. Are you able to provide me with some documents and some example of how you are able to replicate this? It may be just an issue with the model responding differently each time rather than the RAG/pinned documents not working. Closing for now, but feel free to provide more examples and I will reopen the issue if we are able to replicate this.
yindo changed title from [BUG]: Embedded Chat Widget - not considering Query mode option. Always working in Chat mode. to [GH-ISSUE #3147] [BUG]: Embedded Chat Widget - not considering Query mode option. Always working in Chat mode. 2026-06-05 14:44:03 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#2020