The ollama local model cannot be used #8765

Closed
opened 2026-02-21 18:27:29 -05:00 by yindo · 4 comments
Owner

Originally created by @xianghuai-deng on GitHub (Feb 28, 2025).

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

Dify version

v1.0

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

When I installed dify, installed ollama plug-in, and added the locally deployed large language model, dify still reported an error after a timeout. Please reply me how to deal with this situation. Without this problem in dify0.15, dify was able to use the local ollama deployed deepseek model in the same situation

✔️ Expected Behavior

docker-plugin_daemon-1  | 2025/02/28 13:30:54 runtime_lifetime.go:76: [ERROR]init environment failed: failed to install dependencies: exit status 2, output: ERROR: Exception:
docker-plugin_daemon-1  | Traceback (most recent call last):
docker-plugin_daemon-1  |   File "/app/storage/cwd/langgenius/ollama-0.0.3@9ded90ac00e8510119a24be7396ba77191c9610d5e1e29f59d68fa1229822fc7/.venv/lib/python3.12/site-packages/pip/_vendor/urllib3/response.py", line 438, in _error_catcher
docker-plugin_daemon-1  |     yield
docker-plugin_daemon-1  |   File "/app/storage/cwd/langgenius/ollama-0.0.3@9ded90ac00e8510119a24be7396ba77191c9610d5e1e29f59d68fa1229822fc7/.venv/lib/python3.12/site-packages/pip/_vendor/urllib3/response.py", line 561, in read
docker-plugin_daemon-1  |     data = self._fp_read(amt) if not fp_closed else b""
docker-plugin_daemon-1  |            ^^^^^^^^^^^^^^^^^^
docker-plugin_daemon-1  |   File "/app/storage/cwd/langgenius/ollama-0.0.3@9ded90ac00e8510119a24be7396ba77191c9610d5e1e29f59d68fa1229822fc7/.venv/lib/python3.12/site-packages/pip/_vendor/urllib3/response.py", line 527, in _fp_read
docker-plugin_daemon-1  |     return self._fp.read(amt) if amt is not None else self._fp.read()
docker-plugin_daemon-1  |            ^^^^^^^^^^^^^^^^^^
docker-plugin_daemon-1  |   File "/app/storage/cwd/langgenius/ollama-0.0.3@9ded90ac00e8510119a24be7396ba77191c9610d5e1e29f59d68fa1229822fc7/.venv/lib/python3.12/site-packages/pip/_vendor/cachecontrol/filewrapper.py", line 98, in read
docker-plugin_daemon-1  |     data: bytes = self.__fp.read(amt)
docker-plugin_daemon-1  |                   ^^^^^^^^^^^^^^^^^^^
docker-plugin_daemon-1  |   File "/usr/lib/python3.12/http/client.py", line 479, in read
docker-plugin_daemon-1  |     s = self.fp.read(amt)
docker-plugin_daemon-1  |         ^^^^^^^^^^^^^^^^^
docker-plugin_daemon-1  |   File "/usr/lib/python3.12/socket.py", line 707, in readinto
docker-plugin_daemon-1  |     return self._sock.recv_into(b)
docker-plugin_daemon-1  |            ^^^^^^^^^^^^^^^^^^^^^^^
docker-plugin_daemon-1  |   File "/usr/lib/python3.12/ssl.py", line 1252, in recv_into
docker-plugin_daemon-1  |     return self.read(nbytes, buffer)
docker-plugin_daemon-1  |            ^^^^^^^^^^^^^^^^^^^^^^^^^
docker-plugin_daemon-1  |   File "/usr/lib/python3.12/ssl.py", line 1104, in read
docker-plugin_daemon-1  |     return self._sslobj.read(len, buffer)
docker-plugin_daemon-1  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
docker-plugin_daemon-1  | TimeoutError: The read operation timed out
docker-plugin_daemon-1  | 
docker-plugin_daemon-1  | During handling of the above exception, another exception occurred:
docker-plugin_daemon-1  | 
docker-plugin_daemon-1  | Traceback (most recent call last):
docker-plugin_daemon-1  |   File "/app/storage/cwd/langgenius/ollama-0.0.3@9ded90ac00e8510119a24be7396ba77191c9610d5e1e29f59d68fa1229822fc7/.venv/lib/python3.12/site-packages/pip/_internal/cli/base_command.py", line 180, in exc_logging_wrapper
docker-plugin_daemon-1  |     status = run_func(*args)
docker-plugin_daemon-1  |              ^^^^^^^^^^^^^^^
docker-plugin_daemon-1  |   File "/app/storage/cwd/langgenius/ollama-0.0.3@9ded90ac00e8510119a24be7396ba77191c9610d5e1e29f59d68fa1229822fc7/.venv/lib/python3.12/site-packages/pip/_internal/cli/req_command.py", line 245, in wrapper
docker-plugin_daemon-1  |     return func(self, options, args)
docker-plugin_daemon-1  |            ^^^^^^^^^^^^^^^^^^^^^^^^^
docker-plugin_daemon-1  |   File "/app/storage/cwd/langgenius/ollama-0.0.3@9ded90ac00e8510119a24be7396ba77191c9610d5e1e29f59d68fa1229822fc7/.venv/lib/python3.12/site-packages/pip/_internal/commands/install.py", line 377, in run
docker-plugin_daemon-1  |     requirement_set = resolver.resolve(
docker-plugin_daemon-1  |                       ^^^^^^^^^^^^^^^^^
docker-plugin_daemon-1  |   File "/app/storage/cwd/langgenius/ollama-0.0.3@9ded90ac00e8510119a24be7396ba77191c9610d5e1e29f59d68fa1229822fc7/.venv/lib/python3.12/site-packages/pip/_internal/resolution/resolvelib/resolver.py", line 179, in resolve
docker-plugin_daemon-1  |     self.factory.preparer.prepare_linked_requirements_more(reqs)
docker-plugin_daemon-1  |   File "/app/storage/cwd/langgenius/ollama-0.0.3@9ded90ac00e8510119a24be7396ba77191c9610d5e1e29f59d68fa1229822fc7/.venv/lib/python3.12/site-packages/pip/_internal/operations/prepare.py", line 552, in prepare_linked_requirements_more
docker-plugin_daemon-1  |     self._complete_partial_requirements(
docker-plugin_daemon-1  |   File "/app/storage/cwd/langgenius/ollama-0.0.3@9ded90ac00e8510119a24be7396ba77191c9610d5e1e29f59d68fa1229822fc7/.venv/lib/python3.12/site-packages/pip/_internal/operations/prepare.py", line 467, in _complete_partial_requirements
docker-plugin_daemon-1  |     for link, (filepath, _) in batch_download:
docker-plugin_daemon-1  |   File "/app/storage/cwd/langgenius/ollama-0.0.3@9ded90ac00e8510119a24be7396ba77191c9610d5e1e29f59d68fa1229822fc7/.venv/lib/python3.12/site-packages/pip/_internal/network/download.py", line 183, in __call__
docker-plugin_daemon-1  |     for chunk in chunks:
docker-plugin_daemon-1  |   File "/app/storage/cwd/langgenius/ollama-0.0.3@9ded90ac00e8510119a24be7396ba77191c9610d5e1e29f59d68fa1229822fc7/.venv/lib/python3.12/site-packages/pip/_internal/cli/progress_bars.py", line 53, in _rich_progress_bar
docker-plugin_daemon-1  |     for chunk in iterable:
docker-plugin_daemon-1  |   File "/app/storage/cwd/langgenius/ollama-0.0.3@9ded90ac00e8510119a24be7396ba77191c9610d5e1e29f59d68fa1229822fc7/.venv/lib/python3.12/site-packages/pip/_internal/network/utils.py", line 63, in response_chunks
docker-plugin_daemon-1  |     for chunk in response.raw.stream(
docker-plugin_daemon-1  |   File "/app/storage/cwd/langgenius/ollama-0.0.3@9ded90ac00e8510119a24be7396ba77191c9610d5e1e29f59d68fa1229822fc7/.venv/lib/python3.12/site-packages/pip/_vendor/urllib3/response.py", line 622, in stream
docker-plugin_daemon-1  |     data = self.read(amt=amt, decode_content=decode_content)
docker-plugin_daemon-1  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
docker-plugin_daemon-1  |   File "/app/storage/cwd/langgenius/ollama-0.0.3@9ded90ac00e8510119a24be7396ba77191c9610d5e1e29f59d68fa1229822fc7/.venv/lib/python3.12/site-packages/pip/_vendor/urllib3/response.py", line 560, in read
docker-plugin_daemon-1  |     with self._error_catcher():
docker-plugin_daemon-1  |   File "/usr/lib/python3.12/contextlib.py", line 158, in __exit__
docker-plugin_daemon-1  |     self.gen.throw(value)
docker-plugin_daemon-1  |   File "/app/storage/cwd/langgenius/ollama-0.0.3@9ded90ac00e8510119a24be7396ba77191c9610d5e1e29f59d68fa1229822fc7/.venv/lib/python3.12/site-packages/pip/_vendor/urllib3/response.py", line 443, in _error_catcher
docker-plugin_daemon-1  |     raise ReadTimeoutError(self._pool, None, "Read timed out.")
docker-plugin_daemon-1  | pip._vendor.urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='files.pythonhosted.org', port=443): Read timed out.
docker-plugin_daemon-1  | , retry in 30s
docker-sandbox-1        | [GIN] 2025/02/28 - 13:31:03 | 200 |      54.655µs |       127.0.0.1 | GET      "/health"
docker-sandbox-1        | 2025/02/28 13:31:10 server.go:80: [INFO]Updating Python dependencies...

Actual Behavior

No response

Originally created by @xianghuai-deng on GitHub (Feb 28, 2025). ### Self Checks - [x] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [x] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [x] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:) - [x] Please do not modify this template :) and fill in all the required fields. ### Dify version v1.0 ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce When I installed dify, installed ollama plug-in, and added the locally deployed large language model, dify still reported an error after a timeout. Please reply me how to deal with this situation. Without this problem in dify0.15, dify was able to use the local ollama deployed deepseek model in the same situation ### ✔️ Expected Behavior ``` docker-plugin_daemon-1 | 2025/02/28 13:30:54 runtime_lifetime.go:76: [ERROR]init environment failed: failed to install dependencies: exit status 2, output: ERROR: Exception: docker-plugin_daemon-1 | Traceback (most recent call last): docker-plugin_daemon-1 | File "/app/storage/cwd/langgenius/ollama-0.0.3@9ded90ac00e8510119a24be7396ba77191c9610d5e1e29f59d68fa1229822fc7/.venv/lib/python3.12/site-packages/pip/_vendor/urllib3/response.py", line 438, in _error_catcher docker-plugin_daemon-1 | yield docker-plugin_daemon-1 | File "/app/storage/cwd/langgenius/ollama-0.0.3@9ded90ac00e8510119a24be7396ba77191c9610d5e1e29f59d68fa1229822fc7/.venv/lib/python3.12/site-packages/pip/_vendor/urllib3/response.py", line 561, in read docker-plugin_daemon-1 | data = self._fp_read(amt) if not fp_closed else b"" docker-plugin_daemon-1 | ^^^^^^^^^^^^^^^^^^ docker-plugin_daemon-1 | File "/app/storage/cwd/langgenius/ollama-0.0.3@9ded90ac00e8510119a24be7396ba77191c9610d5e1e29f59d68fa1229822fc7/.venv/lib/python3.12/site-packages/pip/_vendor/urllib3/response.py", line 527, in _fp_read docker-plugin_daemon-1 | return self._fp.read(amt) if amt is not None else self._fp.read() docker-plugin_daemon-1 | ^^^^^^^^^^^^^^^^^^ docker-plugin_daemon-1 | File "/app/storage/cwd/langgenius/ollama-0.0.3@9ded90ac00e8510119a24be7396ba77191c9610d5e1e29f59d68fa1229822fc7/.venv/lib/python3.12/site-packages/pip/_vendor/cachecontrol/filewrapper.py", line 98, in read docker-plugin_daemon-1 | data: bytes = self.__fp.read(amt) docker-plugin_daemon-1 | ^^^^^^^^^^^^^^^^^^^ docker-plugin_daemon-1 | File "/usr/lib/python3.12/http/client.py", line 479, in read docker-plugin_daemon-1 | s = self.fp.read(amt) docker-plugin_daemon-1 | ^^^^^^^^^^^^^^^^^ docker-plugin_daemon-1 | File "/usr/lib/python3.12/socket.py", line 707, in readinto docker-plugin_daemon-1 | return self._sock.recv_into(b) docker-plugin_daemon-1 | ^^^^^^^^^^^^^^^^^^^^^^^ docker-plugin_daemon-1 | File "/usr/lib/python3.12/ssl.py", line 1252, in recv_into docker-plugin_daemon-1 | return self.read(nbytes, buffer) docker-plugin_daemon-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^ docker-plugin_daemon-1 | File "/usr/lib/python3.12/ssl.py", line 1104, in read docker-plugin_daemon-1 | return self._sslobj.read(len, buffer) docker-plugin_daemon-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ docker-plugin_daemon-1 | TimeoutError: The read operation timed out docker-plugin_daemon-1 | docker-plugin_daemon-1 | During handling of the above exception, another exception occurred: docker-plugin_daemon-1 | docker-plugin_daemon-1 | Traceback (most recent call last): docker-plugin_daemon-1 | File "/app/storage/cwd/langgenius/ollama-0.0.3@9ded90ac00e8510119a24be7396ba77191c9610d5e1e29f59d68fa1229822fc7/.venv/lib/python3.12/site-packages/pip/_internal/cli/base_command.py", line 180, in exc_logging_wrapper docker-plugin_daemon-1 | status = run_func(*args) docker-plugin_daemon-1 | ^^^^^^^^^^^^^^^ docker-plugin_daemon-1 | File "/app/storage/cwd/langgenius/ollama-0.0.3@9ded90ac00e8510119a24be7396ba77191c9610d5e1e29f59d68fa1229822fc7/.venv/lib/python3.12/site-packages/pip/_internal/cli/req_command.py", line 245, in wrapper docker-plugin_daemon-1 | return func(self, options, args) docker-plugin_daemon-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^ docker-plugin_daemon-1 | File "/app/storage/cwd/langgenius/ollama-0.0.3@9ded90ac00e8510119a24be7396ba77191c9610d5e1e29f59d68fa1229822fc7/.venv/lib/python3.12/site-packages/pip/_internal/commands/install.py", line 377, in run docker-plugin_daemon-1 | requirement_set = resolver.resolve( docker-plugin_daemon-1 | ^^^^^^^^^^^^^^^^^ docker-plugin_daemon-1 | File "/app/storage/cwd/langgenius/ollama-0.0.3@9ded90ac00e8510119a24be7396ba77191c9610d5e1e29f59d68fa1229822fc7/.venv/lib/python3.12/site-packages/pip/_internal/resolution/resolvelib/resolver.py", line 179, in resolve docker-plugin_daemon-1 | self.factory.preparer.prepare_linked_requirements_more(reqs) docker-plugin_daemon-1 | File "/app/storage/cwd/langgenius/ollama-0.0.3@9ded90ac00e8510119a24be7396ba77191c9610d5e1e29f59d68fa1229822fc7/.venv/lib/python3.12/site-packages/pip/_internal/operations/prepare.py", line 552, in prepare_linked_requirements_more docker-plugin_daemon-1 | self._complete_partial_requirements( docker-plugin_daemon-1 | File "/app/storage/cwd/langgenius/ollama-0.0.3@9ded90ac00e8510119a24be7396ba77191c9610d5e1e29f59d68fa1229822fc7/.venv/lib/python3.12/site-packages/pip/_internal/operations/prepare.py", line 467, in _complete_partial_requirements docker-plugin_daemon-1 | for link, (filepath, _) in batch_download: docker-plugin_daemon-1 | File "/app/storage/cwd/langgenius/ollama-0.0.3@9ded90ac00e8510119a24be7396ba77191c9610d5e1e29f59d68fa1229822fc7/.venv/lib/python3.12/site-packages/pip/_internal/network/download.py", line 183, in __call__ docker-plugin_daemon-1 | for chunk in chunks: docker-plugin_daemon-1 | File "/app/storage/cwd/langgenius/ollama-0.0.3@9ded90ac00e8510119a24be7396ba77191c9610d5e1e29f59d68fa1229822fc7/.venv/lib/python3.12/site-packages/pip/_internal/cli/progress_bars.py", line 53, in _rich_progress_bar docker-plugin_daemon-1 | for chunk in iterable: docker-plugin_daemon-1 | File "/app/storage/cwd/langgenius/ollama-0.0.3@9ded90ac00e8510119a24be7396ba77191c9610d5e1e29f59d68fa1229822fc7/.venv/lib/python3.12/site-packages/pip/_internal/network/utils.py", line 63, in response_chunks docker-plugin_daemon-1 | for chunk in response.raw.stream( docker-plugin_daemon-1 | File "/app/storage/cwd/langgenius/ollama-0.0.3@9ded90ac00e8510119a24be7396ba77191c9610d5e1e29f59d68fa1229822fc7/.venv/lib/python3.12/site-packages/pip/_vendor/urllib3/response.py", line 622, in stream docker-plugin_daemon-1 | data = self.read(amt=amt, decode_content=decode_content) docker-plugin_daemon-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ docker-plugin_daemon-1 | File "/app/storage/cwd/langgenius/ollama-0.0.3@9ded90ac00e8510119a24be7396ba77191c9610d5e1e29f59d68fa1229822fc7/.venv/lib/python3.12/site-packages/pip/_vendor/urllib3/response.py", line 560, in read docker-plugin_daemon-1 | with self._error_catcher(): docker-plugin_daemon-1 | File "/usr/lib/python3.12/contextlib.py", line 158, in __exit__ docker-plugin_daemon-1 | self.gen.throw(value) docker-plugin_daemon-1 | File "/app/storage/cwd/langgenius/ollama-0.0.3@9ded90ac00e8510119a24be7396ba77191c9610d5e1e29f59d68fa1229822fc7/.venv/lib/python3.12/site-packages/pip/_vendor/urllib3/response.py", line 443, in _error_catcher docker-plugin_daemon-1 | raise ReadTimeoutError(self._pool, None, "Read timed out.") docker-plugin_daemon-1 | pip._vendor.urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='files.pythonhosted.org', port=443): Read timed out. docker-plugin_daemon-1 | , retry in 30s docker-sandbox-1 | [GIN] 2025/02/28 - 13:31:03 | 200 | 54.655µs | 127.0.0.1 | GET "/health" docker-sandbox-1 | 2025/02/28 13:31:10 server.go:80: [INFO]Updating Python dependencies... ``` ### ❌ Actual Behavior _No response_
yindo added the 🐞 bug label 2026-02-21 18:27:29 -05:00
yindo closed this issue 2026-02-21 18:27:29 -05:00
Author
Owner

@dosubot[bot] commented on GitHub (Feb 28, 2025):

@xianghuai-deng Hello there! I'm here to assist you with any bugs, questions, or contributions you have regarding the Dify platform.

I found some similar discussions and issues related to the timeout error when using the Ollama local model with Dify:

  1. What is the reason for the request timed out when saving the model? - This discussion suggests increasing the timeout duration in the source code and environment variables, and ensuring a stable network connection [1].

  2. Can't add the Ollama Models - This discussion is unsolved but might provide additional context [2].

  3. Help: I got an error user ollama with model llava-phi3 - Another unsolved discussion that might be relevant [3].

To resolve the timeout error, you can try the following steps:

  1. Modify the timeout in the source code file api/core/model_runtime/model_providers/ollama/llm/llm.py by changing line 60 from timeout=(10, 300) to a longer duration, such as timeout=(10, 3600) for 60 minutes.

  2. Update the following environment variables in the docker/.env file:

    • APP_MAX_EXECUTION_TIME=3600
    • API_TOOL_DEFAULT_READ_TIMEOUT=3600
    • WORKFLOW_MAX_EXECUTION_TIME=3600
    • HTTP_REQUEST_MAX_CONNECT_TIMEOUT=3600
    • HTTP_REQUEST_MAX_READ_TIMEOUT=3600
    • HTTP_REQUEST_MAX_WRITE_TIMEOUT=3600
  3. Rebuild the API service from source using docker-compose.

  4. Ensure your network connection is stable. If you're using Clash as your proxy, enable global TUN mode, as this has been confirmed to solve the installation timeout problem when downloading plugins from the Dify marketplace [4][5][6].

  5. If you encounter connection errors when configuring Ollama, replace your local IP address with http://host.docker.internal:11434 in the Ollama configuration [5].

These steps should help resolve the timeout issue you're experiencing with the Ollama local model in Dify version 1.0.

To continue talking to Dosu, mention @dosu.


Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Bug Report | Other

@dosubot[bot] commented on GitHub (Feb 28, 2025): <!-- Greeting --> @xianghuai-deng Hello there! I'm here to assist you with any bugs, questions, or contributions you have regarding the Dify platform. <!-- Answer --> I found some similar discussions and issues related to the timeout error when using the Ollama local model with Dify: 1. [What is the reason for the request timed out when saving the model?](https://github.com/langgenius/dify/discussions/14017) - This discussion suggests increasing the timeout duration in the source code and environment variables, and ensuring a stable network connection <sup>[[1]](https://github.com/langgenius/dify/discussions/14017)</sup>. 2. [Can't add the Ollama Models](https://github.com/langgenius/dify/discussions/12336) - This discussion is unsolved but might provide additional context <sup>[[2]](https://github.com/langgenius/dify/discussions/12336)</sup>. 3. [Help: I got an error user ollama with model llava-phi3](https://github.com/langgenius/dify/discussions/11717) - Another unsolved discussion that might be relevant <sup>[[3]](https://github.com/langgenius/dify/discussions/11717)</sup>. To resolve the timeout error, you can try the following steps: 1. Modify the timeout in the source code file `api/core/model_runtime/model_providers/ollama/llm/llm.py` by changing line 60 from `timeout=(10, 300)` to a longer duration, such as `timeout=(10, 3600)` for 60 minutes. 2. Update the following environment variables in the `docker/.env` file: - `APP_MAX_EXECUTION_TIME=3600` - `API_TOOL_DEFAULT_READ_TIMEOUT=3600` - `WORKFLOW_MAX_EXECUTION_TIME=3600` - `HTTP_REQUEST_MAX_CONNECT_TIMEOUT=3600` - `HTTP_REQUEST_MAX_READ_TIMEOUT=3600` - `HTTP_REQUEST_MAX_WRITE_TIMEOUT=3600` 3. Rebuild the API service from source using `docker-compose`. 4. Ensure your network connection is stable. If you're using Clash as your proxy, enable global TUN mode, as this has been confirmed to solve the installation timeout problem when downloading plugins from the Dify marketplace <sup>[[4]](https://github.com/langgenius/dify/issues/14535)</sup><sup>[[5]](https://github.com/langgenius/dify/issues/14331)</sup><sup>[[6]](https://github.com/langgenius/dify/issues/12987)</sup>. 5. If you encounter connection errors when configuring Ollama, replace your local IP address with `http://host.docker.internal:11434` in the Ollama configuration <sup>[[5]](https://github.com/langgenius/dify/issues/14331)</sup>. These steps should help resolve the timeout issue you're experiencing with the Ollama local model in Dify version 1.0. <!-- Dosu Comment Footer --> *To continue talking to [Dosu](https://dosu.dev), mention @dosu.* --- <sup>Help Dosu learn! Give it feedback: [Great Response](https://app.dosu.dev/response-feedback/85c56118-066f-4f43-b38f-416d226a72bb?feedback_type=great_response) | [Irrelevant Answer](https://app.dosu.dev/response-feedback/85c56118-066f-4f43-b38f-416d226a72bb?feedback_type=irrelevant_answer) | [Incorrect Sources](https://app.dosu.dev/response-feedback/85c56118-066f-4f43-b38f-416d226a72bb?feedback_type=incorrect_sources) | [Too Verbose](https://app.dosu.dev/response-feedback/85c56118-066f-4f43-b38f-416d226a72bb?feedback_type=too_verbose) | [Hallucination](https://app.dosu.dev/response-feedback/85c56118-066f-4f43-b38f-416d226a72bb?feedback_type=hallucination) | [Bug Report](https://app.dosu.dev/response-feedback/85c56118-066f-4f43-b38f-416d226a72bb?feedback_type=bug_report) | [Other](https://app.dosu.dev/response-feedback/85c56118-066f-4f43-b38f-416d226a72bb?feedback_type=other)</sup>
Author
Owner

@kanxue-team commented on GitHub (Feb 28, 2025):

Image

Image

The same issue occurs with one of my machines in an internal network environment, running CentOS with Docker, where I can deploy up to version 1.0 and add model links without any problems. However, on a machine exposed to the public internet, running AlmaLinux with Docker, I am unable to add model plugins after deployment. This issue affects all models, including Ollama and Deepseek.

@kanxue-team commented on GitHub (Feb 28, 2025): ![Image](https://github.com/user-attachments/assets/90c7e4b1-1a7c-4d0e-a388-f62ffbeaf2ec) ![Image](https://github.com/user-attachments/assets/144fbb93-6e81-4b68-9d16-384eee0914cb) The same issue occurs with one of my machines in an internal network environment, running CentOS with Docker, where I can deploy up to version 1.0 and add model links without any problems. However, on a machine exposed to the public internet, running AlmaLinux with Docker, I am unable to add model plugins after deployment. This issue affects all models, including Ollama and Deepseek.
Author
Owner

@kanxue-team commented on GitHub (Feb 28, 2025):

As it is an online website customer service system, after upgrading to version 1.0, the system has become unusable due to the inability to add models. This is causing great urgency, and we hope the official team can provide a solution. For instance, is it possible to modify the database to incorporate models?

@kanxue-team commented on GitHub (Feb 28, 2025): As it is an online website customer service system, after upgrading to version 1.0, the system has become unusable due to the inability to add models. This is causing great urgency, and we hope the official team can provide a solution. For instance, is it possible to modify the database to incorporate models?
Author
Owner

@daixixidai commented on GitHub (Mar 2, 2025):

I solved this problem by modifying the docker-compose.yaml file,change all dify-api and dify-web version to 0.15.3,then I can add the ollama models。
https://blog.51cto.com/u_13563176/13390099
Image

@daixixidai commented on GitHub (Mar 2, 2025): I solved this problem by modifying the docker-compose.yaml file,change all dify-api and dify-web version to 0.15.3,then I can add the ollama models。 https://blog.51cto.com/u_13563176/13390099 ![Image](https://github.com/user-attachments/assets/dbc85a94-3b60-42c0-9c14-4593a8798892)
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#8765