Unable to download pipelines from a private repo #111

Open
opened 2026-02-15 19:15:58 -05:00 by yindo · 2 comments
Owner

Originally created by @talliansaotome on GitHub (Sep 4, 2024).

https://github.com/open-webui/pipelines/blob/d4fca4c37c4b8603be7797245e749e9086f35130/start.sh#L52

The download_pipelines function is a bit too explicitly geared towards public github repos. I am currently attempting to download from a private repo that requires authentication, for these things usually passed in the form of
https://:@gitlab.contoso.local/namespace/repo.git, or namespace/repo/filename.ext. The parsing to validate an HTTP url is specific enough that its either github, or a single file.

Related, but in a different function, the requirements.txt file apparently has to already be local, it would be nice if it could either read from a repo, or run after pulling the repo so you can get a requirements.txt from the repo itself.
https://github.com/open-webui/pipelines/blob/d4fca4c37c4b8603be7797245e749e9086f35130/start.sh#L33

Thanks!

Originally created by @talliansaotome on GitHub (Sep 4, 2024). https://github.com/open-webui/pipelines/blob/d4fca4c37c4b8603be7797245e749e9086f35130/start.sh#L52 The download_pipelines function is a bit too explicitly geared towards public github repos. I am currently attempting to download from a private repo that requires authentication, for these things usually passed in the form of https://<user>:<accesstoken>@gitlab.contoso.local/namespace/repo.git, or namespace/repo/filename.ext. The parsing to validate an HTTP url is specific enough that its either github, or a single file. Related, but in a different function, the requirements.txt file apparently has to already be local, it would be nice if it could either read from a repo, or run after pulling the repo so you can get a requirements.txt from the repo itself. https://github.com/open-webui/pipelines/blob/d4fca4c37c4b8603be7797245e749e9086f35130/start.sh#L33 Thanks!
Author
Owner

@sir3mat commented on GitHub (Nov 11, 2024):

follow

@sir3mat commented on GitHub (Nov 11, 2024): follow
Author
Owner

@karan-jani commented on GitHub (Feb 6, 2025):

Has anyone found a workaround? Running this in minikube.

Was able to cp the .py file from my project directory into the pipeline container but this was not recognized, assuming it is not compatible with the start.sh function.

Wondering if I need an s3 bucket, etc. Do not want to go down route of github token in url, etc.

@karan-jani commented on GitHub (Feb 6, 2025): Has anyone found a workaround? Running this in minikube. Was able to cp the .py file from my project directory into the pipeline container but this was not recognized, assuming it is not compatible with the start.sh function. Wondering if I need an s3 bucket, etc. Do not want to go down route of github token in url, etc.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: open-webui/pipelines#111