Unexpected connection issue at LLM node #9523

Closed
opened 2026-02-21 18:35:44 -05:00 by yindo · 0 comments
Owner

Originally created by @zydisney on GitHub (Mar 6, 2025).

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

Dify version

1.0.0

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

Since I need to deploy dify on a offline server, I have to config everything on an computer that connect to the internet. Then pack all docker images and deploy in the offline server. The dify can be run on the offline server, but the LLM seems need to connect to internet.
I have 2 LLM model backend, one is Xinference the other one is vLLM connect with "OpenAI-API-compatible".
In Workflow mode the LLM node response:
Xinference Model node show error

Run failed: [xinference] Error: PluginInvokeError: {"args":{},"error_type":"ConnectionError","message":"HTTPSConnectionPool(host='openaipublic.blob.core.windows.net', port=443): Max retries exceeded with url: /gpt-2/encodings/main/vocab.bpe (Caused by NameResolutionError("\u003curllib3.connection.HTTPSConnection object at 0x7377b2956270\u003e: Failed to resolve 'openaipublic.blob.core.windows.net' ([Errno -3] Temporary failure in name resolution)"))"}

OpenAI-API-compatible Model node show the response for first conversation, than show error since second response

Run failed: PluginInvokeError: {"args":{},"error_type":"ConnectionError","message":"HTTPSConnectionPool(host='openaipublic.blob.core.windows.net', port=443): Max retries exceeded with url: /gpt-2/encodings/main/vocab.bpe (Caused by NameResolutionError("\u003curllib3.connection.HTTPSConnection object at 0x7673d41ae150\u003e: Failed to resolve 'openaipublic.blob.core.windows.net' ([Errno -3] Temporary failure in name resolution)"))"}

✔️ Expected Behavior

No response

Actual Behavior

No response

Originally created by @zydisney on GitHub (Mar 6, 2025). ### Self Checks - [x] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [x] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [x] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:) - [x] Please do not modify this template :) and fill in all the required fields. ### Dify version 1.0.0 ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce Since I need to deploy dify on a offline server, I have to config everything on an computer that connect to the internet. Then pack all docker images and deploy in the offline server. The dify can be run on the offline server, but the LLM seems need to connect to internet. I have 2 LLM model backend, one is Xinference the other one is vLLM connect with "OpenAI-API-compatible". In Workflow mode the LLM node response: Xinference Model node show error ``` Run failed: [xinference] Error: PluginInvokeError: {"args":{},"error_type":"ConnectionError","message":"HTTPSConnectionPool(host='openaipublic.blob.core.windows.net', port=443): Max retries exceeded with url: /gpt-2/encodings/main/vocab.bpe (Caused by NameResolutionError("\u003curllib3.connection.HTTPSConnection object at 0x7377b2956270\u003e: Failed to resolve 'openaipublic.blob.core.windows.net' ([Errno -3] Temporary failure in name resolution)"))"} ``` OpenAI-API-compatible Model node show the response for first conversation, than show error since second response ``` Run failed: PluginInvokeError: {"args":{},"error_type":"ConnectionError","message":"HTTPSConnectionPool(host='openaipublic.blob.core.windows.net', port=443): Max retries exceeded with url: /gpt-2/encodings/main/vocab.bpe (Caused by NameResolutionError("\u003curllib3.connection.HTTPSConnection object at 0x7673d41ae150\u003e: Failed to resolve 'openaipublic.blob.core.windows.net' ([Errno -3] Temporary failure in name resolution)"))"} ``` ### ✔️ Expected Behavior _No response_ ### ❌ Actual Behavior _No response_
yindo added the 🐞 bug label 2026-02-21 18:35:44 -05:00
yindo closed this issue 2026-02-21 18:35:44 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#9523