mirror of
https://github.com/langchain-ai/langserve.git
synced 2026-07-18 10:54:29 -04:00
Hold off sending response to server until after first chunk to improve how errors are surfaced #108
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @eyurtsev on GitHub (Jan 26, 2024).
Originally assigned to: @eyurtsev on GitHub.
Hold off sending a response from the server to the client for streaming end points until after the first chunk of the runnable was returned.
This allow sending back an actual http error to the client making errors more obvious
@eyurtsev commented on GitHub (Feb 6, 2024):
See this discussion: https://github.com/langchain-ai/langserve/discussions/433
@ByPatrick commented on GitHub (Mar 13, 2024):
Hello, has there been any progress or plans regarding this issue? I am asking because I am encountering the same problem, where the client always receives a 500 error, but I would like to provide more details.