LangServe playground crashes on browser due to out of memory #205

Open
opened 2026-02-16 00:19:24 -05:00 by yindo · 2 comments
Owner

Originally created by @explocion on GitHub (Jun 30, 2024).

Description:
I was trying to build a RAG application where the retrieved context is HUGE. When I run it from the langserve playground, my browser crashes due to out of memory. I suspect it was because saving the stream log in the frontend was using to much memory (64 chunks with 2000 characters per chunk).

Steps to Reproduce:

  1. Build a RAG application
  2. Retrieve with a large context

Attempted Solution:
Reducing the number of chunks works, but I really need a huge number of chunks for my application.

Originally created by @explocion on GitHub (Jun 30, 2024). Description: I was trying to build a RAG application where the retrieved context is HUGE. When I run it from the langserve playground, my browser crashes due to out of memory. I suspect it was because saving the stream log in the frontend was using to much memory (64 chunks with 2000 characters per chunk). Steps to Reproduce: 1. Build a RAG application 2. Retrieve with a large context Attempted Solution: Reducing the number of chunks works, but I really need a huge number of chunks for my application.
Author
Owner

@juliushuck commented on GitHub (Jul 21, 2024):

Same problem here stream_logs seems to get a lot of events and then the browser tab crashes. I also retrieve with a huge retriever that is using a lot of llm calls and so on.

@juliushuck commented on GitHub (Jul 21, 2024): Same problem here stream_logs seems to get a lot of events and then the browser tab crashes. I also retrieve with a huge retriever that is using a lot of llm calls and so on.
Author
Owner

@wywgong commented on GitHub (Nov 14, 2024):

Same problem here, it seems the stream_logs return too many intermediate process data.

@wywgong commented on GitHub (Nov 14, 2024): Same problem here, it seems the stream_logs return too many intermediate process data.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langchain-ai/langserve#205