langgenius/dify
1
0
Fork 0
mirror of https://github.com/langgenius/dify.git synced 2026-07-22 20:45:26 -04:00
Code Issues 775 Packages Projects Releases 10 Wiki Activity

Xorbits Inference ERROR [models.py:162] e3ae1c8d20 Failed to save model credentials, tenant_id: 743f48dc-c307-41d0-8db1-e11c2af24df4, model: bge-reranker-large, model_type: rerank #13216

New Issue
Closed
opened 2026-02-21 19:11:06 -05:00 by yindo · 2 comments
yindo commented 2026-02-21 19:11:06 -05:00
Owner
Copy Link
Copy Source

Originally created by @gg22mm on GitHub (Apr 22, 2025).

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:)
  • Please do not modify this template :) and fill in all the required fields.

Dify version

https://github.com/langgenius/dify.git

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

Image

Image

Image

Image

Image

✔️ Expected Behavior

No response

❌ Actual Behavior

'''python

2025-04-22 07:25:15,358 INFO [_internal.py:97] 10.10.10.248 - - [22/Apr/2025 07:25:15] "OPTIONS /console/api/workspaces/current/model-providers/langgenius/xinference/xinference/models HTTP/1.1" 200 -
2025-04-22 07:25:15,465 ERROR [models.py:162] fc880a1de8 Failed to save model credentials, tenant_id: 743f48dc-c307-41d0-8db1-e11c2af24df4, model: bge-reranker-large, model_type: rerank
Traceback (most recent call last):
File "/paddle/www/txsb/api/dz_open_api/dify-main/api/controllers/console/workspace/models.py", line 154, in post
model_provider_service.save_model_credentials(
File "/paddle/www/txsb/api/dz_open_api/dify-main/api/services/model_provider_service.py", line 237, in save_model_credentials
provider_configuration.add_or_update_custom_model_credentials(
File "/paddle/www/txsb/api/dz_open_api/dify-main/api/core/entities/provider_configuration.py", line 422, in add_or_update_custom_model_credentials
provider_model_record, credentials = self.custom_model_credentials_validate(model_type, model, credentials)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/paddle/www/txsb/api/dz_open_api/dify-main/api/core/entities/provider_configuration.py", line 402, in custom_model_credentials_validate
credentials = model_provider_factory.model_credentials_validate(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/paddle/www/txsb/api/dz_open_api/dify-main/api/core/model_runtime/model_providers/model_provider_factory.py", line 191, in model_credentials_validate
self.plugin_model_manager.validate_model_credentials(
File "/paddle/www/txsb/api/dz_open_api/dify-main/api/core/plugin/manager/model.py", line 137, in validate_model_credentials
for resp in response:
^^^^^^^^
File "/paddle/www/txsb/api/dz_open_api/dify-main/api/core/plugin/manager/base.py", line 189, in _request_with_plugin_daemon_response_stream
self._handle_plugin_daemon_error(error.error_type, error.message)
File "/paddle/www/txsb/api/dz_open_api/dify-main/api/core/plugin/manager/base.py", line 219, in _handle_plugin_daemon_error
raise CredentialsValidateFailedError(error_object.get("message"))
core.model_runtime.errors.validate.CredentialsValidateFailedError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
2025-04-22 07:25:15,468 INFO [_internal.py:97] 10.10.10.248 - - [22/Apr/2025 07:25:15] "POST /console/api/workspaces/current/model-providers/langgenius/xinference/xinference/models HTTP/1.1" 400 -

get xinference model extra parameter failed, url: http://10.10.10.123:33853/v1/models/bge-m3, error: HTTPConnectionPool(host='10.10.10.123', port=33853): Max retries exceeded with url: /v1/models/bge-m3 (Caused by ProtocolError('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')))

'''

Originally created by @gg22mm on GitHub (Apr 22, 2025). ### Self Checks - [x] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [x] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [x] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:) - [x] Please do not modify this template :) and fill in all the required fields. ### Dify version https://github.com/langgenius/dify.git ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce ![Image](https://github.com/user-attachments/assets/5ac660dc-b852-4e52-b3a5-8a9b13e3ed93) ![Image](https://github.com/user-attachments/assets/7ca8fcf9-6b76-47c2-a9d1-dd7e321a8dec) ![Image](https://github.com/user-attachments/assets/e89332c4-0ae2-4e50-99c0-1604abe88bf2) ![Image](https://github.com/user-attachments/assets/e9bac189-c0fa-49e0-9865-f4e08bb08f72) ![Image](https://github.com/user-attachments/assets/599489e1-135a-4191-b15e-a4adc59d1998) ### ✔️ Expected Behavior _No response_ ### ❌ Actual Behavior '''python 2025-04-22 07:25:15,358 INFO [_internal.py:97] 10.10.10.248 - - [22/Apr/2025 07:25:15] "OPTIONS /console/api/workspaces/current/model-providers/langgenius/xinference/xinference/models HTTP/1.1" 200 - 2025-04-22 07:25:15,465 ERROR [models.py:162] fc880a1de8 Failed to save model credentials, tenant_id: 743f48dc-c307-41d0-8db1-e11c2af24df4, model: bge-reranker-large, model_type: rerank Traceback (most recent call last): File "/paddle/www/txsb/api/dz_open_api/dify-main/api/controllers/console/workspace/models.py", line 154, in post model_provider_service.save_model_credentials( File "/paddle/www/txsb/api/dz_open_api/dify-main/api/services/model_provider_service.py", line 237, in save_model_credentials provider_configuration.add_or_update_custom_model_credentials( File "/paddle/www/txsb/api/dz_open_api/dify-main/api/core/entities/provider_configuration.py", line 422, in add_or_update_custom_model_credentials provider_model_record, credentials = self.custom_model_credentials_validate(model_type, model, credentials) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/paddle/www/txsb/api/dz_open_api/dify-main/api/core/entities/provider_configuration.py", line 402, in custom_model_credentials_validate credentials = model_provider_factory.model_credentials_validate( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/paddle/www/txsb/api/dz_open_api/dify-main/api/core/model_runtime/model_providers/model_provider_factory.py", line 191, in model_credentials_validate self.plugin_model_manager.validate_model_credentials( File "/paddle/www/txsb/api/dz_open_api/dify-main/api/core/plugin/manager/model.py", line 137, in validate_model_credentials for resp in response: ^^^^^^^^ File "/paddle/www/txsb/api/dz_open_api/dify-main/api/core/plugin/manager/base.py", line 189, in _request_with_plugin_daemon_response_stream self._handle_plugin_daemon_error(error.error_type, error.message) File "/paddle/www/txsb/api/dz_open_api/dify-main/api/core/plugin/manager/base.py", line 219, in _handle_plugin_daemon_error raise CredentialsValidateFailedError(error_object.get("message")) core.model_runtime.errors.validate.CredentialsValidateFailedError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) 2025-04-22 07:25:15,468 INFO [_internal.py:97] 10.10.10.248 - - [22/Apr/2025 07:25:15] "POST /console/api/workspaces/current/model-providers/langgenius/xinference/xinference/models HTTP/1.1" 400 - get xinference model extra parameter failed, url: http://10.10.10.123:33853/v1/models/bge-m3, error: HTTPConnectionPool(host='10.10.10.123', port=33853): Max retries exceeded with url: /v1/models/bge-m3 (Caused by ProtocolError('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))) '''
yindo closed this issue 2026-02-21 19:11:06 -05:00
yindo commented 2026-02-21 19:11:06 -05:00
Author
Owner
Copy Link
Copy Source

@dosubot[bot] commented on GitHub (Apr 22, 2025):

Hello @gg22mm! I'm Dosu, your friendly bot here to help you with bugs, answer questions, and assist you in becoming a contributor. I'm here to support you while you wait for a human maintainer. What can I help you with today?

I found a similar closed issue that might help you resolve the connection issues when adding Xorbits Inference models like "bge-reranker-large" and "bge-m3" in a self-hosted Docker environment. The suggested solution is to use the machine's IP address instead of 127.0.0.1 when trying to connect, as 127.0.0.1 or localhost points to your host system by default, not the internal network of the Docker container. You can refer to the documentation for more details: here [1].

Additionally, ensure that the Weaviate service is started using Docker Compose, as the error messages indicating "Connection aborted" and "Max retries exceeded" are likely due to the Weaviate service not being started by default. If you encounter connection issues, consider replacing '127.0.0.1' with 'host.docker.internal' in your configuration to ensure proper communication between Docker containers. Also, if you have system proxy environment variables (HTTP_PROXY and HTTPS_PROXY) set, they might be causing connection issues. You can try unsetting these proxy environment variables before running Docker Compose by using the following commands:

unset HTTP_PROXY
unset HTTPS_PROXY

This should help resolve the connection issues [2].

To continue talking to Dosu, mention @dosu.

Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Bug Report | Other

@dosubot[bot] commented on GitHub (Apr 22, 2025): <!-- Greeting --> Hello @gg22mm! I'm [Dosu](https://dosu.dev), your friendly bot here to help you with bugs, answer questions, and assist you in becoming a contributor. I'm here to support you while you wait for a human maintainer. What can I help you with today? <!-- Answer --> I found a similar closed issue that might help you resolve the connection issues when adding Xorbits Inference models like "bge-reranker-large" and "bge-m3" in a self-hosted Docker environment. The suggested solution is to use the machine's IP address instead of 127.0.0.1 when trying to connect, as 127.0.0.1 or localhost points to your host system by default, not the internal network of the Docker container. You can refer to the documentation for more details: [here](https://docs.dify.ai/v/zh-hans/guides/model-configuration/xinference) <sup>[[1]](https://github.com/langgenius/dify/issues/1836)</sup>. Additionally, ensure that the Weaviate service is started using Docker Compose, as the error messages indicating "Connection aborted" and "Max retries exceeded" are likely due to the Weaviate service not being started by default. If you encounter connection issues, consider replacing '127.0.0.1' with 'host.docker.internal' in your configuration to ensure proper communication between Docker containers. Also, if you have system proxy environment variables (HTTP_PROXY and HTTPS_PROXY) set, they might be causing connection issues. You can try unsetting these proxy environment variables before running Docker Compose by using the following commands: ```bash unset HTTP_PROXY unset HTTPS_PROXY ``` This should help resolve the connection issues <sup>[[2]](https://github.com/langgenius/dify/issues/14533)</sup>. <!-- Dosu Comment Footer --> *To continue talking to [Dosu](https://dosu.dev), mention @dosu.* --- <sup>Help Dosu learn! Give it feedback: [Great Response](https://app.dosu.dev/response-feedback/ad043007-2433-42df-9754-d24edfbab464?feedback_type=great_response) | [Irrelevant Answer](https://app.dosu.dev/response-feedback/ad043007-2433-42df-9754-d24edfbab464?feedback_type=irrelevant_answer) | [Incorrect Sources](https://app.dosu.dev/response-feedback/ad043007-2433-42df-9754-d24edfbab464?feedback_type=incorrect_sources) | [Too Verbose](https://app.dosu.dev/response-feedback/ad043007-2433-42df-9754-d24edfbab464?feedback_type=too_verbose) | [Hallucination](https://app.dosu.dev/response-feedback/ad043007-2433-42df-9754-d24edfbab464?feedback_type=hallucination) | [Bug Report](https://app.dosu.dev/response-feedback/ad043007-2433-42df-9754-d24edfbab464?feedback_type=bug_report) | [Other](https://app.dosu.dev/response-feedback/ad043007-2433-42df-9754-d24edfbab464?feedback_type=other)</sup>
yindo commented 2026-02-21 19:11:07 -05:00
Author
Owner
Copy Link
Copy Source

@gg22mm commented on GitHub (Apr 22, 2025):

原来用的是：http://10.10.10.123:9997 拍大腿啊~~

@gg22mm commented on GitHub (Apr 22, 2025): 原来用的是：http://10.10.10.123:9997 拍大腿啊~~
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Knowledge Pipeline
Proposal
WIP
cloud
dependencies
feat:webapp
good first issue
outdated
performance
pull-request
Mirrored from GitHub Pull Request
 python:uv
refactor
size:L
stale
status: accepting prs
status: blocked
status: in discussion
stt & tts
vulnerablity
web
wont-fix
🌊 feat:workflow
🌚 invalid
🐞 bug
👻 feat:rag
💪 enhancement
📚 documentation
🔨 feat:tools
🙋‍♂️ question
🙏 help wanted
🤔 cant-reproduce
🤖 feat:agent
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#13216
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?