[GH-ISSUE #5240] [FEAT]: Provide SSE support for ordinary conversation requests #4979

Closed
opened 2026-06-05 14:51:16 -04:00 by yindo · 2 comments
Owner

Originally created by @listenerri on GitHub (Mar 19, 2026).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/5240

What would you like to see?

Currently, when @agent is not used, ordinary conversation requests seem to be just a regular POST request, merely waiting for a one-time response content. However, most current models support the thinking mode. The thinking stage may last for a long time, but the conversation box merely waits without showing the thinking content. Moreover, after a long period of thinking, an error prompt may be displayed because the POST request has timed out and the reply data has not been received.

Originally created by @listenerri on GitHub (Mar 19, 2026). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/5240 ### What would you like to see? Currently, when @agent is not used, ordinary conversation requests seem to be just a regular POST request, merely waiting for a one-time response content. However, most current models support the thinking mode. The thinking stage may last for a long time, but the conversation box merely waits without showing the thinking content. Moreover, after a long period of thinking, an error prompt may be displayed because the POST request has timed out and the reply data has not been received.
yindo added the enhancementfeature request labels 2026-06-05 14:51:16 -04:00
yindo closed this issue 2026-06-05 14:51:16 -04:00
Author
Owner

@nehaaprasad commented on GitHub (Mar 20, 2026):

@listenerri please check out the PR

<!-- gh-comment-id:4095799291 --> @nehaaprasad commented on GitHub (Mar 20, 2026): @listenerri please check out the PR
Author
Owner

@timothycarambat commented on GitHub (Mar 20, 2026):

This is functionally true and there is an internal effort to rework that entire pipeline to normalize it for all chat modes - since the frontend API is not meant for any external use there isnt so much of a feature here, as much as it is a chore. It is considered technical debt for sure and there is an upcoming overhaul that will touch it in the near future - where it should get handled 👍

<!-- gh-comment-id:4101277239 --> @timothycarambat commented on GitHub (Mar 20, 2026): This is functionally true and there is an internal effort to rework that entire pipeline to normalize it for all chat modes - since the frontend API is not meant for any external use there isnt so much of a feature here, as much as it is a chore. It is considered technical debt for sure and there is an upcoming overhaul that will touch it in the near future - where it should get handled 👍
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#4979