use sse to support human in the loop? #1

Open
opened 2026-02-16 02:16:56 -05:00 by yindo · 0 comments
Owner

Originally created by @qiankunli on GitHub (Mar 2, 2025).

If using Server-Sent Events (SSE) instead of WebSockets to interact with the front end, how can i achieve the effect of waiting for user feedback? Answering a question may trigger two API calls.

user:  Book me a flight ticket.
AI:Where do you want to go?
user: new york
AI: xxx

this may trigger two /v1/chat api,How to treat them as a single llm qa process.

Originally created by @qiankunli on GitHub (Mar 2, 2025). If using Server-Sent Events (SSE) instead of WebSockets to interact with the front end, how can i achieve the effect of waiting for user feedback? Answering a question may trigger two API calls. ``` user: Book me a flight ticket. AI:Where do you want to go? user: new york AI: xxx ``` this may trigger two `/v1/chat` api,How to treat them as a single llm qa process.
Sign in to join this conversation.
No Label
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: run-llama/human_in_the_loop_workflow_demo#1