mirror of
https://github.com/open-webui/helm-charts.git
synced 2026-07-22 09:55:25 -04:00
CrashLoopBackOff offline installation #16
Closed
opened 2026-02-15 19:15:27 -05:00 by yindo
·
11 comments
No Branch/Tag Specified
main
gh-pages
feat-oikb
feat-release-v0.10.2
automation/open-webui-0.10.2
feat-release-v0.10.1
automation/open-webui-0.10.1
feat-release-v0.10.0
automation/open-webui-0.10.0
feat-terminals-security
fix-openai-base-urls
v6.0.0
revert-196-issue-184/add-milvus
release-pipelines-v0.1.0
open-webui-15.2.1-dev.94.1
open-webui-15.2.1-dev.93.1
open-webui-15.2.1-dev.92.1
open-webui-15.2.1-dev.88.1
open-webui-15.2.1-dev.89.1
open-webui-15.2.1-dev.90.1
open-webui-15.2.1-dev.91.1
open-webui-15.2.1-dev.87.1
open-webui-15.2.1-dev.85.1
open-webui-15.2.1-dev.86.1
open-webui-15.2.1-dev.84.1
open-webui-15.2.1-dev.69.1
open-webui-15.2.1-dev.70.1
open-webui-15.2.1-dev.71.1
open-webui-15.2.1-dev.72.1
open-webui-15.2.1-dev.73.1
open-webui-15.2.1-dev.74.1
open-webui-15.2.1-dev.75.1
open-webui-15.2.1-dev.76.1
open-webui-15.2.1-dev.77.1
open-webui-15.2.1-dev.78.1
open-webui-15.2.1-dev.79.1
open-webui-15.2.1-dev.80.1
open-webui-15.2.1-dev.81.1
open-webui-15.2.1-dev.82.1
open-webui-15.2.1-dev.83.1
open-webui-15.2.1-dev.66.1
open-webui-15.2.1-dev.67.1
open-webui-15.2.1-dev.68.1
open-webui-15.2.1-dev.55.1
open-webui-15.2.1-dev.56.1
open-webui-15.2.1-dev.57.1
open-webui-15.2.1-dev.58.1
open-webui-15.2.1-dev.59.1
open-webui-15.2.1-dev.60.1
open-webui-15.2.1-dev.61.1
open-webui-15.2.1-dev.62.1
open-webui-15.2.1-dev.63.1
open-webui-15.2.1-dev.64.1
open-webui-15.2.1-dev.65.1
open-webui-15.2.1-dev.49.1
open-webui-15.2.1-dev.50.1
open-webui-15.2.1-dev.51.1
open-webui-15.2.1-dev.52.1
open-webui-15.2.1-dev.53.1
open-webui-15.2.1-dev.54.1
open-webui-15.2.1-dev.39.1
open-webui-15.2.1-dev.40.1
open-webui-15.2.1-dev.41.1
open-webui-15.2.1-dev.42.1
open-webui-15.2.1-dev.43.1
open-webui-15.2.1-dev.44.1
open-webui-15.2.1-dev.45.1
open-webui-15.2.1-dev.46.1
open-webui-15.2.1-dev.47.1
open-webui-15.2.1-dev.48.1
open-webui-15.2.1-dev.26.1
open-webui-15.2.1-dev.27.1
open-webui-15.2.1-dev.28.1
open-webui-15.2.1-dev.29.1
open-webui-15.2.1-dev.30.1
open-webui-15.2.1-dev.31.1
open-webui-15.2.1-dev.32.1
open-webui-15.2.1-dev.33.1
open-webui-15.2.1-dev.35.1
open-webui-15.2.1-dev.36.1
open-webui-15.2.1-dev.37.1
open-webui-15.2.1-dev.38.1
open-webui-15.2.1-dev.34.1
open-webui-15.2.1-dev.24.1
open-webui-15.2.1-dev.25.1
open-webui-15.2.1-dev.22.1
open-webui-15.2.1-dev.23.1
open-webui-15.2.1-dev.20.1
open-webui-15.2.1-dev.21.1
open-webui-15.2.1-dev.18.1
open-webui-15.2.1-dev.17.1
open-webui-15.2.1-dev.19.1
open-webui-15.2.1-dev.16.1
open-webui-15.2.0
open-webui-15.1.1-dev.15.1
open-webui-15.1.1-dev.14.1
open-webui-15.1.1-dev.13.1
open-webui-15.1.1-dev.12.1
open-webui-15.1.1-dev.11.1
open-webui-15.1.1-dev.10.1
open-webui-15.1.1-dev.7.1
open-webui-15.1.1-dev.6.1
open-webui-15.1.1-dev.9.1
open-webui-15.1.1-dev.8.1
open-webui-15.1.0
open-webui-15.0.0
terminals-0.5.0
open-webui-14.11.0
open-webui-14.10.0
pipelines-0.12.0
open-webui-14.9.0
open-webui-14.8.0
open-webui-14.7.0
terminals-0.4.0
open-webui-14.6.0
open-webui-14.5.0
open-webui-14.4.0
open-webui-14.3.0
terminals-0.3.0
open-webui-14.2.0
open-webui-14.1.0
open-webui-14.0.0
open-webui-13.3.1
open-webui-13.3.0
open-webui-13.2.1
open-webui-13.2.0
open-webui-13.1.2
open-webui-13.1.1
open-webui-13.1.0
open-webui-13.0.1
terminals-0.2.0
open-webui-13.0.0
terminals-0.1.0
open-webui-12.13.0
open-webui-12.12.0
open-webui-12.11.0
open-webui-12.10.0
open-webui-12.9.0
open-webui-12.8.1
open-webui-12.8.0
pipelines-0.11.0
open-webui-12.7.0
open-webui-12.6.0
open-webui-12.5.0
open-webui-12.4.0
open-webui-12.3.0
open-webui-12.2.0
open-webui-12.1.1
open-webui-12.1.0
open-webui-12.0.1
pipelines-0.10.1
open-webui-12.0.0
open-webui-11.1.0
open-webui-11.0.0
open-webui-10.2.1
open-webui-10.2.0
open-webui-10.1.0
open-webui-10.0.0
open-webui-9.0.0
open-webui-8.22.1
open-webui-8.22.0
open-webui-8.21.0
open-webui-8.20.0
open-webui-8.19.0
open-webui-8.18.0
open-webui-8.17.0
open-webui-8.16.0
open-webui-8.15.0
open-webui-8.14.0
open-webui-8.13.0
open-webui-8.12.3
open-webui-8.12.2
pipelines-0.10.0
open-webui-8.12.1
open-webui-8.12.0
open-webui-8.11.0
open-webui-8.10.0
open-webui-8.9.0
open-webui-8.8.0
open-webui-8.7.0
open-webui-8.6.0
open-webui-8.5.0
open-webui-8.4.0
open-webui-8.3.0
open-webui-8.2.0
pipelines-0.9.0
pipelines-0.8.0
open-webui-8.1.0
open-webui-8.0.0
open-webui-7.7.0
open-webui-7.6.0
open-webui-7.5.0
open-webui-7.4.0
open-webui-7.3.0
open-webui-7.2.0
open-webui-7.1.0
open-webui-7.0.1
open-webui-7.0.0
open-webui-6.29.0
open-webui-6.28.0
open-webui-6.27.0
open-webui-6.26.0
open-webui-6.25.0
open-webui-6.24.0
open-webui-6.23.0
open-webui-6.22.0
open-webui-6.21.0
open-webui-6.20.0
open-webui-6.19.0
open-webui-6.18.0
open-webui-6.17.0
pipelines-0.7.0
open-webui-6.16.0
open-webui-6.15.0
open-webui-6.14.0
open-webui-6.13.0
open-webui-6.12.0
open-webui-6.11.0
open-webui-6.10.0
pipelines-0.6.0
open-webui-6.9.0
open-webui-6.8.0
open-webui-6.7.0
open-webui-6.6.0
open-webui-6.5.0
open-webui-6.4.0
open-webui-6.3.0
open-webui-6.2.0
open-webui-6.1.0
open-webui-6.0.0
open-webui-5.26.0
open-webui-5.25.0
open-webui-5.24.0
open-webui-5.23.0
pipelines-0.5.0
open-webui-5.22.0
open-webui-5.21.0
open-webui-5.20.0
open-webui-5.19.0
pipelines-0.4.0
open-webui-5.18.0
open-webui-5.17.0
pipelines-0.3.0
open-webui-5.16.1
open-webui-5.16.0
pipelines-0.2.0
open-webui-5.15.0
open-webui-5.14.0
open-webui-5.13.0
open-webui-5.12.0
open-webui-5.11.0
open-webui-5.10.1
open-webui-5.10.0
open-webui-5.4.0
open-webui-5.3.0
pipelines-0.1.0
open-webui-5.2.0
open-webui-5.1.1
open-webui-5.1.0
open-webui-5.0.1
open-webui-5.0.0
open-webui-4.1.0
open-webui-4.0.7
pipelines-0.0.6
open-webui-4.0.6
pipelines-0.0.5
open-webui-4.0.5
open-webui-4.0.4
open-webui-4.0.3
open-webui-4.0.2
open-webui-4.0.1
v3.8.0
open-webui-3.8.0
open-webui-4.0.0
v3.7.0
v3.6.0
v1.0.0
open-webui-3.6.0
open-webui-3.5.1
open-webui-3.5.0
open-webui-3.4.3
open-webui-3.4.0
open-webui-3.3.2
open-webui-3.3.1
open-webui-3.3.0
open-webui-3.2.0
open-webui-3.1.19
open-webui-3.1.18
open-webui-3.1.17
open-webui-3.1.16
open-webui-3.1.15
open-webui-3.1.14
open-webui-3.1.13
open-webui-3.1.12
open-webui-3.1.11
open-webui-3.1.10
open-webui-3.1.9
open-webui-3.1.8
open-webui-3.1.7
open-webui-3.1.6
pipelines-0.0.4
open-webui-3.1.5
open-webui-3.1.4
open-webui-3.1.3
open-webui-3.1.2
open-webui-3.1.1
open-webui-3.1.0
open-webui-3.0.10
open-webui-3.0.9
open-webui-3.0.8
open-webui-3.0.7
open-webui-3.0.6
open-webui-3.0.5
open-webui-3.0.4
open-webui-3.0.3
open-webui-3.0.2
pipelines-0.0.3
open-webui-3.0.1
pipelines-0.0.2
open-webui-3.0.0
pipelines-0.0.1
open-webui-2.1.0
open-webui-2.0.2
open-webui-2.0.1
open-webui-1.0.1
open-webui-1.0.0
Milestone
No items
No Milestone
Projects
Clear projects
No project
Notifications
Due Date
No due date set.
Dependencies
No dependencies set.
Reference: open-webui/helm-charts#16
Reference in New Issue
Block a user
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @redno2 on GitHub (Jun 14, 2024).
Bug Report
Description
Bug Summary:
Try to deploy the helm chart and kubernetes manifests, both fail in offline setup.
"Cannot determine model snapshot path: Cannot find an appropriate cached snapshot folder for the specified revision on the local disk and outgoing traffic has been disabled. To enable repo look-ups and downloads online, pass 'local_files_only=False' as input."
Try to tests without success:
https://github.com/open-webui/open-webui/discussions/918
https://github.com/open-webui/open-webui/pull/1419
Steps to Reproduce:
Deploy in offline mode
Expected Behavior:
Work without internet connection
Actual Behavior:
Pod CrashLoopBackOff
Environment
Open WebUI Version: 0.3.4 and dev
Ollama (if applicable): 0.1.43
Operating System: Ubuntu 22.04
Reproduction Details
Confirmation:
Logs and Screenshots
Docker Container Logs:
Installation Method
Both method here : https://docs.openwebui.com/getting-started/installation
Installed to a local kind cluster
Additional Information
@westbrook-ai commented on GitHub (Jun 14, 2024):
I ran into a similar issues last week when working on a Minikube cluster without any internet access. The workaround that fixed it for me was to set
extraEnvVars.RAG_EMBEDDING_MODEL_AUTO_UPDATEtoFalse.It's worth noting that according to the docs, that value should be the default in Open WebUI: https://docs.openwebui.com/getting-started/env-configuration#rag_embedding_model_auto_update
So we need to dig into why the pod isn't ending up with that value. Let me know if that fix works for you too, and we can look at adding an input value for offline installations that automatically sets that, or figuring out why/ where that value is being overwritten.
@redno2 commented on GitHub (Jun 17, 2024):
I've already tried setting this variable in the deployment but it doesn't change the behavior on my side. Tested with the lates,dev, fixed tag versions.
My values-test.yaml
The "all" status
The var is well set in the pod, but doesn't change,
@redno2 commented on GitHub (Jun 19, 2024):
same with the latest version 3.0.4
@Ljohn001 commented on GitHub (Jun 25, 2024):
I found a solution, mainly due to network reasons can not be embedded in the current models--sentence-transformers--all-MiniLM-L6-v2 model, can be added in extraEnvVars:
-name: HF_ENDPOINT.
Value: "https://hf-mirror.com" @redno2
@westbrook-ai commented on GitHub (Jun 26, 2024):
Not trying to ignore this issue, I have a lot going on right now. As soon as I can find the time to dig deeper into this, I'll push a fix.
@redno2 commented on GitHub (Jul 15, 2024):
Thanks, but it won't solve the problem because I'm in offline mode.
@srik65 commented on GitHub (Jul 18, 2024):
Any suggestions on this, facing same issue with offline install..
`
k logs -f open-webui-0 -n open-webui
Loading WEBUI_SECRET_KEY from file, not provided as an environment variable.
Generating WEBUI_SECRET_KEY
Loading WEBUI_SECRET_KEY from .webui_secret_key
/app
USER_AGENT environment variable not set, consider setting it to identify your requests.
Cannot determine model snapshot path: Cannot find an appropriate cached snapshot folder for the specified revision on the local disk and outgoing traffic has been disabled. To enable repo look-ups and downloads online, pass 'local_files_only=False' as input.
Traceback (most recent call last):
File "/app/backend/apps/rag/utils.py", line 353, in get_model_path
model_repo_path = snapshot_download(**snapshot_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
return fn(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/huggingface_hub/_snapshot_download.py", line 220, in snapshot_download
raise LocalEntryNotFoundError(
huggingface_hub.utils._errors.LocalEntryNotFoundError: Cannot find an appropriate cached snapshot folder for the specified revision on the local disk and outgoing traffic has been disabled. To enable repo look-ups and downloads online, pass 'local_files_only=False' as input.
No sentence-transformers model found with name sentence-transformers/all-MiniLM-L6-v2. Creating a new one with mean pooling.
Traceback (most recent call last):
File "/usr/local/lib/python3.11/site-packages/urllib3/connection.py", line 196, in _new_conn
sock = connection.create_connection(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/urllib3/util/connection.py", line 85, in create_connection
raise err
File "/usr/local/lib/python3.11/site-packages/urllib3/util/connection.py", line 73, in create_connection
sock.connect(sa)
OSError: [Errno 101] Network is unreachable
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.11/site-packages/urllib3/connectionpool.py", line 789, in urlopen
response = self._make_request(
^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/urllib3/connectionpool.py", line 490, in _make_request
raise new_e
File "/usr/local/lib/python3.11/site-packages/urllib3/connectionpool.py", line 466, in _make_request
self._validate_conn(conn)
File "/usr/local/lib/python3.11/site-packages/urllib3/connectionpool.py", line 1095, in _validate_conn
conn.connect()
File "/usr/local/lib/python3.11/site-packages/urllib3/connection.py", line 615, in connect
self.sock = sock = self._new_conn()
^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/urllib3/connection.py", line 211, in _new_conn
raise NewConnectionError(
urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPSConnection object at 0x7f411159f310>: Failed to establish a new connection: [Errno 101] Network is unreachable
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.11/site-packages/requests/adapters.py", line 667, in send
resp = conn.urlopen(
^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/urllib3/connectionpool.py", line 843, in urlopen
retries = retries.increment(
^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/urllib3/util/retry.py", line 519, in increment
raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /sentence-transformers/all-MiniLM-L6-v2/resolve/main/config.json (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f411159f310>: Failed to establish a new connection: [Errno 101] Network is unreachable'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.11/site-packages/huggingface_hub/file_download.py", line 1722, in _get_metadata_or_catch_error
metadata = get_hf_file_metadata(url=url, proxies=proxies, timeout=etag_timeout, headers=headers)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
return fn(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/huggingface_hub/file_download.py", line 1645, in get_hf_file_metadata
r = _request_wrapper(
^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/huggingface_hub/file_download.py", line 372, in _request_wrapper
response = _request_wrapper(
^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/huggingface_hub/file_download.py", line 395, in _request_wrapper
response = get_session().request(method=method, url=url, **params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/huggingface_hub/utils/_http.py", line 66, in send
return super().send(request, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/requests/adapters.py", line 700, in send
raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: (MaxRetryError("HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /sentence-transformers/all-MiniLM-L6-v2/resolve/main/config.json (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f411159f310>: Failed to establish a new connection: [Errno 101] Network is unreachable'))"), '(Request ID: 9f548bfb-7d60-465b-8f6e-317111ce21d8)')
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.11/site-packages/transformers/utils/hub.py", line 402, in cached_file
resolved_file = hf_hub_download(
^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
return fn(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/huggingface_hub/file_download.py", line 1221, in hf_hub_download
return _hf_hub_download_to_cache_dir(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/huggingface_hub/file_download.py", line 1325, in _hf_hub_download_to_cache_dir
_raise_on_head_call_error(head_call_error, force_download, local_files_only)
File "/usr/local/lib/python3.11/site-packages/huggingface_hub/file_download.py", line 1826, in _raise_on_head_call_error
raise LocalEntryNotFoundError(
huggingface_hub.utils._errors.LocalEntryNotFoundError: An error happened while trying to locate the file on the Hub and we cannot find the requested files in the local cache. Please check your connection and try again or make sure your Internet connection is on.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/bin/uvicorn", line 8, in
sys.exit(main())
^^^^^^
File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1157, in call
return self.main(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1078, in main
rv = self.invoke(ctx)
^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1434, in invoke
return ctx.invoke(self.callback, **ctx.params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/click/core.py", line 783, in invoke
return __callback(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 410, in main
run(
File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 578, in run
server.run()
File "/usr/local/lib/python3.11/site-packages/uvicorn/server.py", line 61, in run
return asyncio.run(self.serve(sockets=sockets))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/asyncio/runners.py", line 190, in run
return runner.run(main)
^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/asyncio/runners.py", line 118, in run
return self.loop.run_until_complete(task)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "uvloop/loop.pyx", line 1517, in uvloop.loop.Loop.run_until_complete
File "/usr/local/lib/python3.11/site-packages/uvicorn/server.py", line 68, in serve
config.load()
File "/usr/local/lib/python3.11/site-packages/uvicorn/config.py", line 473, in load
self.loaded_app = import_from_string(self.app)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/uvicorn/importer.py", line 21, in import_from_string
module = importlib.import_module(module_str)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/importlib/__init_.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "", line 1204, in _gcd_import
File "", line 1176, in _find_and_load
File "", line 1147, in _find_and_load_unlocked
File "", line 690, in _load_unlocked
File "", line 940, in exec_module
File "", line 241, in _call_with_frames_removed
File "/app/backend/main.py", line 46, in
from apps.rag.main import app as rag_app
File "/app/backend/apps/rag/main.py", line 223, in
update_embedding_model(
File "/app/backend/apps/rag/main.py", line 198, in update_embedding_model
app.state.sentence_transformer_ef = sentence_transformers.SentenceTransformer(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/sentence_transformers/SentenceTransformer.py", line 299, in init
modules = self._load_auto_model(
^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/sentence_transformers/SentenceTransformer.py", line 1324, in _load_auto_model
transformer_model = Transformer(
^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/sentence_transformers/models/Transformer.py", line 53, in init
config = AutoConfig.from_pretrained(model_name_or_path, **config_args, cache_dir=cache_dir)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/transformers/models/auto/configuration_auto.py", line 965, in from_pretrained
config_dict, unused_kwargs = PretrainedConfig.get_config_dict(pretrained_model_name_or_path, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/transformers/configuration_utils.py", line 632, in get_config_dict
config_dict, kwargs = cls._get_config_dict(pretrained_model_name_or_path, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/transformers/configuration_utils.py", line 689, in _get_config_dict
resolved_config_file = cached_file(
^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/transformers/utils/hub.py", line 445, in cached_file
raise EnvironmentError(
OSError: We couldn't connect to 'https://huggingface.co' to load this file, couldn't find it in the cached files and it looks like sentence-transformers/all-MiniLM-L6-v2 is not the path to a directory containing a file named config.json.
Checkout your internet connection or see how to run the library in offline mode at 'https://huggingface.co/docs/transformers/installation#offline-mode'.
`
@westbrook-ai commented on GitHub (Jul 22, 2024):
I'm working with the maintainer to see if we can address this in Open WebUI itself since the issue originates from the model attempting to install on Open WebUI startup. I'll keep you all updated, thanks for your patience.
@westbrook-ai commented on GitHub (Jul 23, 2024):
I got some good input from another maintainer:
Upon researching this further, it seems the most viable option is to create an init container that will copy the existing contents of
/app/data/backend(the location of the Kubernetes volume) from the Docker image to the resulting volume to ensure that the faulty model is present, and that the HuggingFace download is not attempted since the model is present locally.I'm going to spend some time on this now, will see if I can get a working solution.
@westbrook-ai commented on GitHub (Jul 23, 2024):
I think I got this fixed here: https://github.com/open-webui/helm-charts/pull/53
I turned my internet off on my test machine to ensure that I replicated the offline environment that's been reported for this issue, and was able to get Open WebUI to start without the HuggingFace errors since the model is now correctly copied into the pod using the init container.
@redno2 @srik65 please try the offline install again with Chart v3.1.0 and let me know if that solves the issue for you, or what new issues you run into.
@redno2 commented on GitHub (Jul 30, 2024):
Yes, it works (tested with the 3.1.1) ! Thanks for the fix 👍