Accessing documents in the pipelines container #126

Open
opened 2026-02-15 19:16:05 -05:00 by yindo · 1 comment
Owner

Originally created by @afonso-ccg on GitHub (Sep 23, 2024).

I am struggling to access the documents that I upload in the Open WebUI interface. How can I do it? Is there an API? In the Custom RAG example there is this piece of code:

self.documents = SimpleDirectoryReader("./data").load_data()

but for me that returns nothing, and I got to understand that as the pipeline is running on a separate container, the path that I’m trying to access in that piece of code is in the pipelines container. Is there any way to do this?

Originally created by @afonso-ccg on GitHub (Sep 23, 2024). I am struggling to access the documents that I upload in the Open WebUI interface. How can I do it? Is there an API? In the Custom RAG example there is this piece of code: self.documents = SimpleDirectoryReader("./data").load_data() but for me that returns nothing, and I got to understand that as the pipeline is running on a separate container, the path that I’m trying to access in that piece of code is in the pipelines container. Is there any way to do this?
Author
Owner

@jasgeo75 commented on GitHub (Nov 30, 2024):

There may be an easier way, but I've switched from using sqlite w/ webui.db (the default) to using postgres and qdrant. This allows for the separation needed for my pipeline to work. My script looks up the collections associated with the 'knowledge' in postgres and the I can feed those details in when searching in qdrant, but I do find the use of collections as they are currently implemented to be sub-optimal; it would be great to see multi-tenancy.

@jasgeo75 commented on GitHub (Nov 30, 2024): There may be an easier way, but I've switched from using sqlite w/ webui.db (the default) to using postgres and qdrant. This allows for the separation needed for my pipeline to work. My script looks up the collections associated with the 'knowledge' in postgres and the I can feed those details in when searching in qdrant, but I do find the use of collections as they are currently implemented to be sub-optimal; it would be great to see multi-tenancy.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: open-webui/pipelines#126