Async support for pipe #164

New Issue

2026-02-15T19:16:26-05:00

yindo commented

2026-02-15 19:16:26 -05:00

Originally created by @almajo on GitHub (Dec 5, 2024).

Hi,

I was wondering why there was no async version of pipe available? I have a rag module that can be run completely asynchronous with different calls to LLMs and Vector stores. I would love if we could use an AsyncGenerator as well as a return type for the pipe.

Any thoughts on that?

As most pipelines are calls to other APIs, Async support would make a lot of sense in my opinion.

Originally created by @almajo on GitHub (Dec 5, 2024). Hi, I was wondering why there was no async version of pipe available? I have a rag module that can be run completely asynchronous with different calls to LLMs and Vector stores. I would love if we could use an AsyncGenerator as well as a return type for the pipe. Any thoughts on that? As most pipelines are calls to other APIs, Async support would make a lot of sense in my opinion.

yindo commented

2026-02-15 19:16:27 -05:00

@bahrikutlu commented on GitHub (Dec 20, 2024):

You should be able to start an event loop inside the synchronous pipe function and process multiple tasks in parallel. Starting an LLM conversation to generate the boilerplate code is a good start. That is how I figured it out.

@bahrikutlu commented on GitHub (Dec 20, 2024): You should be able to start an event loop inside the synchronous pipe function and process multiple tasks in parallel. Starting an LLM conversation to generate the boilerplate code is a good start. That is how I figured it out.

Sign in to join this conversation.

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: open-webui/pipelines#164