mirror of
https://github.com/langchain-ai/langserve.git
synced 2026-07-19 22:03:48 -04:00
LangServe playground crashes on browser due to out of memory #205
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @explocion on GitHub (Jun 30, 2024).
Description:
I was trying to build a RAG application where the retrieved context is HUGE. When I run it from the langserve playground, my browser crashes due to out of memory. I suspect it was because saving the stream log in the frontend was using to much memory (64 chunks with 2000 characters per chunk).
Steps to Reproduce:
Attempted Solution:
Reducing the number of chunks works, but I really need a huge number of chunks for my application.
@juliushuck commented on GitHub (Jul 21, 2024):
Same problem here stream_logs seems to get a lot of events and then the browser tab crashes. I also retrieve with a huge retriever that is using a lot of llm calls and so on.
@wywgong commented on GitHub (Nov 14, 2024):
Same problem here, it seems the stream_logs return too many intermediate process data.