No endpoints in Docker #188

Open
opened 2026-02-15 19:16:40 -05:00 by yindo · 4 comments
Owner

Originally created by @regularRandom on GitHub (Feb 4, 2025).

Here is the issue: open-webui doesn't detect pipelines. I installed open-webui & pipelines as Docker images and they are accessible through the host.docker.internal address. But: open-webui says Ollama: Network Problem when I click on refresh button in connection setup. Logs from pipelines:

RESET_PIPELINES_DIR is not set to true. No action taken.
requirements.txt not found at /app. Skipping installation of requirements.
Downloading pipeline files from https://github.com/open-webui/pipelines/blob/main/examples/filters/detoxify_filter_pipeline.py to ./pipelines...
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 2870 100 2870 0 0 6944 0 --:--:-- --:--:-- --:--:-- 6944
INFO: Started server process [14]
INFO: Waiting for application startup.
Requirement already satisfied: detoxify in /usr/local/lib/python3.11/site-packages (0.5.2)
Requirement already satisfied: transformers in /usr/local/lib/python3.11/site-packages (from detoxify) (4.47.1)
Requirement already satisfied: torch>=1.7.0 in /usr/local/lib/python3.11/site-packages (from detoxify) (2.5.1+cpu)
Requirement already satisfied: sentencepiece>=0.1.94 in /usr/local/lib/python3.11/site-packages (from detoxify) (0.2.0)
Requirement already satisfied: filelock in /usr/local/lib/python3.11/site-packages (from torch>=1.7.0->detoxify) (3.13.1)
Requirement already satisfied: typing-extensions>=4.8.0 in /usr/local/lib/python3.11/site-packages (from torch>=1.7.0->detoxify) (4.9.0)
Requirement already satisfied: networkx in /usr/local/lib/python3.11/site-packages (from torch>=1.7.0->detoxify) (3.2.1)
Requirement already satisfied: jinja2 in /usr/local/lib/python3.11/site-packages (from torch>=1.7.0->detoxify) (3.1.3)
Requirement already satisfied: fsspec in /usr/local/lib/python3.11/site-packages (from torch>=1.7.0->detoxify) (2024.2.0)
Requirement already satisfied: sympy==1.13.1 in /usr/local/lib/python3.11/site-packages (from torch>=1.7.0->detoxify) (1.13.1)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in /usr/local/lib/python3.11/site-packages (from sympy==1.13.1->torch>=1.7.0->detoxify) (1.3.0)
Requirement already satisfied: huggingface-hub<1.0,>=0.24.0 in /usr/local/lib/python3.11/site-packages (from transformers->detoxify) (0.27.0)
Requirement already satisfied: numpy>=1.17 in /usr/local/lib/python3.11/site-packages (from transformers->detoxify) (1.26.3)
Requirement already satisfied: packaging>=20.0 in /usr/local/lib/python3.11/site-packages (from transformers->detoxify) (24.2)
Requirement already satisfied: pyyaml>=5.1 in /usr/local/lib/python3.11/site-packages (from transformers->detoxify) (6.0.2)
Requirement already satisfied: regex!=2019.12.17 in /usr/local/lib/python3.11/site-packages (from transformers->detoxify) (2024.11.6)
Requirement already satisfied: requests in /usr/local/lib/python3.11/site-packages (from transformers->detoxify) (2.32.2)
Requirement already satisfied: tokenizers<0.22,>=0.21 in /usr/local/lib/python3.11/site-packages (from transformers->detoxify) (0.21.0)
Requirement already satisfied: safetensors>=0.4.1 in /usr/local/lib/python3.11/site-packages (from transformers->detoxify) (0.5.0)
Requirement already satisfied: tqdm>=4.27 in /usr/local/lib/python3.11/site-packages (from transformers->detoxify) (4.67.1)
Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.11/site-packages (from jinja2->torch>=1.7.0->detoxify) (2.1.5)
Requirement already satisfied: charset-normalizer<4,>=2 in /usr/local/lib/python3.11/site-packages (from requests->transformers->detoxify) (3.4.1)
Requirement already satisfied: idna<4,>=2.5 in /usr/local/lib/python3.11/site-packages (from requests->transformers->detoxify) (3.10)
Requirement already satisfied: urllib3<3,>=1.21.1 in /usr/local/lib/python3.11/site-packages (from requests->transformers->detoxify) (2.3.0)
Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.11/site-packages (from requests->transformers->detoxify) (2024.12.14)
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning.
INFO: Application startup complete.
INFO: Uvicorn running on http://0.0.0.0:9099 (Press CTRL+C to quit)
Installing requirement: detoxify
Loaded module: detoxify_filter_pipeline
on_startup:detoxify_filter_pipeline
INFO: 172.17.0.1:48096 - "GET /api/version HTTP/1.1" 404 Not Found

Logs of open-webui:

ERROR [open_webui.routers.ollama] Unexpected error: HTTP Error: 404
Traceback (most recent call last):
File "/app/backend/open_webui/routers/ollama.py", line 204, in verify_connection
raise Exception(detail)
Exception: HTTP Error: 404
INFO: 192.168.0.94:54262 - "POST /ollama/verify HTTP/1.1" 500 Internal Server Error

I tried /info, /api/version - nothing, Unicorn is completely blank.

My docker command:

docker run -d -p 9099:9099 \
  -e PIPELINES_REQUIREMENTS_PATH=/app \
  -e PIPELINES_URLS="https://github.com/open-webui/pipelines/blob/main/examples/filters/detoxify_filter_pipeline.py" \
  --add-host=host.docker.internal:host-gateway \
  -v /opt/ai/pipelines:/app/pipelines \
  --name pipelines \
  --restart always \
  ghcr.io/open-webui/pipelines:main

open-webui v0.5.7

What I missed?

Originally created by @regularRandom on GitHub (Feb 4, 2025). Here is the issue: open-webui doesn't detect pipelines. I installed open-webui & pipelines as Docker images and they are accessible through the host.docker.internal address. But: open-webui says **Ollama: Network Problem** when I click on refresh button in connection setup. Logs from pipelines: > RESET_PIPELINES_DIR is not set to true. No action taken. > requirements.txt not found at /app. Skipping installation of requirements. > Downloading pipeline files from https://github.com/open-webui/pipelines/blob/main/examples/filters/detoxify_filter_pipeline.py to ./pipelines... > % Total % Received % Xferd Average Speed Time Time Time Current > Dload Upload Total Spent Left Speed > 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 > 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 > 100 2870 100 2870 0 0 6944 0 --:--:-- --:--:-- --:--:-- 6944 > INFO: Started server process [14] > INFO: Waiting for application startup. > Requirement already satisfied: detoxify in /usr/local/lib/python3.11/site-packages (0.5.2) > Requirement already satisfied: transformers in /usr/local/lib/python3.11/site-packages (from detoxify) (4.47.1) > Requirement already satisfied: torch>=1.7.0 in /usr/local/lib/python3.11/site-packages (from detoxify) (2.5.1+cpu) > Requirement already satisfied: sentencepiece>=0.1.94 in /usr/local/lib/python3.11/site-packages (from detoxify) (0.2.0) > Requirement already satisfied: filelock in /usr/local/lib/python3.11/site-packages (from torch>=1.7.0->detoxify) (3.13.1) > Requirement already satisfied: typing-extensions>=4.8.0 in /usr/local/lib/python3.11/site-packages (from torch>=1.7.0->detoxify) (4.9.0) > Requirement already satisfied: networkx in /usr/local/lib/python3.11/site-packages (from torch>=1.7.0->detoxify) (3.2.1) > Requirement already satisfied: jinja2 in /usr/local/lib/python3.11/site-packages (from torch>=1.7.0->detoxify) (3.1.3) > Requirement already satisfied: fsspec in /usr/local/lib/python3.11/site-packages (from torch>=1.7.0->detoxify) (2024.2.0) > Requirement already satisfied: sympy==1.13.1 in /usr/local/lib/python3.11/site-packages (from torch>=1.7.0->detoxify) (1.13.1) > Requirement already satisfied: mpmath<1.4,>=1.1.0 in /usr/local/lib/python3.11/site-packages (from sympy==1.13.1->torch>=1.7.0->detoxify) (1.3.0) > Requirement already satisfied: huggingface-hub<1.0,>=0.24.0 in /usr/local/lib/python3.11/site-packages (from transformers->detoxify) (0.27.0) > Requirement already satisfied: numpy>=1.17 in /usr/local/lib/python3.11/site-packages (from transformers->detoxify) (1.26.3) > Requirement already satisfied: packaging>=20.0 in /usr/local/lib/python3.11/site-packages (from transformers->detoxify) (24.2) > Requirement already satisfied: pyyaml>=5.1 in /usr/local/lib/python3.11/site-packages (from transformers->detoxify) (6.0.2) > Requirement already satisfied: regex!=2019.12.17 in /usr/local/lib/python3.11/site-packages (from transformers->detoxify) (2024.11.6) > Requirement already satisfied: requests in /usr/local/lib/python3.11/site-packages (from transformers->detoxify) (2.32.2) > Requirement already satisfied: tokenizers<0.22,>=0.21 in /usr/local/lib/python3.11/site-packages (from transformers->detoxify) (0.21.0) > Requirement already satisfied: safetensors>=0.4.1 in /usr/local/lib/python3.11/site-packages (from transformers->detoxify) (0.5.0) > Requirement already satisfied: tqdm>=4.27 in /usr/local/lib/python3.11/site-packages (from transformers->detoxify) (4.67.1) > Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.11/site-packages (from jinja2->torch>=1.7.0->detoxify) (2.1.5) > Requirement already satisfied: charset-normalizer<4,>=2 in /usr/local/lib/python3.11/site-packages (from requests->transformers->detoxify) (3.4.1) > Requirement already satisfied: idna<4,>=2.5 in /usr/local/lib/python3.11/site-packages (from requests->transformers->detoxify) (3.10) > Requirement already satisfied: urllib3<3,>=1.21.1 in /usr/local/lib/python3.11/site-packages (from requests->transformers->detoxify) (2.3.0) > Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.11/site-packages (from requests->transformers->detoxify) (2024.12.14) > WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning. > INFO: Application startup complete. > INFO: Uvicorn running on http://0.0.0.0:9099 (Press CTRL+C to quit) > Installing requirement: detoxify > Loaded module: detoxify_filter_pipeline > on_startup:detoxify_filter_pipeline > INFO: 172.17.0.1:48096 - "GET /api/version HTTP/1.1" 404 Not Found Logs of open-webui: > ERROR [open_webui.routers.ollama] Unexpected error: HTTP Error: 404 > Traceback (most recent call last): > File "/app/backend/open_webui/routers/ollama.py", line 204, in verify_connection > raise Exception(detail) > Exception: HTTP Error: 404 > INFO: 192.168.0.94:54262 - "POST /ollama/verify HTTP/1.1" 500 Internal Server Error I tried /info, /api/version - nothing, Unicorn is completely blank. My docker command: ``` docker run -d -p 9099:9099 \ -e PIPELINES_REQUIREMENTS_PATH=/app \ -e PIPELINES_URLS="https://github.com/open-webui/pipelines/blob/main/examples/filters/detoxify_filter_pipeline.py" \ --add-host=host.docker.internal:host-gateway \ -v /opt/ai/pipelines:/app/pipelines \ --name pipelines \ --restart always \ ghcr.io/open-webui/pipelines:main ``` open-webui v0.5.7 What I missed?
Author
Owner

@algowifi commented on GitHub (Feb 11, 2025):

Also with open-webui v0.5.10

@algowifi commented on GitHub (Feb 11, 2025): Also with open-webui v0.5.10
Author
Owner

@algowifi commented on GitHub (Feb 11, 2025):

Resolve: put http://host.docker.internal:9099 inside API OpenAI not in Ollama API.

@algowifi commented on GitHub (Feb 11, 2025): Resolve: put http://host.docker.internal:9099 inside API OpenAI not in Ollama API.
Author
Owner

@regularRandom commented on GitHub (Feb 12, 2025):

@algowifi yes, that works, thank you! But why OpenAI?

@regularRandom commented on GitHub (Feb 12, 2025): @algowifi yes, that works, thank you! But why OpenAI?
Author
Owner

@iwoork commented on GitHub (Feb 15, 2025):

Why does this only work on OpenAI section and not on Ollama?

@iwoork commented on GitHub (Feb 15, 2025): Why does this only work on OpenAI section and not on Ollama?
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: open-webui/pipelines#188