mirror of
https://github.com/open-webui/pipelines.git
synced 2026-07-20 15:38:19 -04:00
Accessing documents in the pipelines container #126
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @afonso-ccg on GitHub (Sep 23, 2024).
I am struggling to access the documents that I upload in the Open WebUI interface. How can I do it? Is there an API? In the Custom RAG example there is this piece of code:
self.documents = SimpleDirectoryReader("./data").load_data()
but for me that returns nothing, and I got to understand that as the pipeline is running on a separate container, the path that I’m trying to access in that piece of code is in the pipelines container. Is there any way to do this?
@jasgeo75 commented on GitHub (Nov 30, 2024):
There may be an easier way, but I've switched from using sqlite w/ webui.db (the default) to using postgres and qdrant. This allows for the separation needed for my pipeline to work. My script looks up the collections associated with the 'knowledge' in postgres and the I can feed those details in when searching in qdrant, but I do find the use of collections as they are currently implemented to be sub-optimal; it would be great to see multi-tenancy.