mirror of
https://github.com/langgenius/dify-official-plugins.git
synced 2026-07-21 17:45:23 -04:00
Add ranker model by Xinference plugin timeout #182
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @cainiaodidi on GitHub (Apr 9, 2025).
Self Checks
Dify version
1.1.3
Cloud or Self Hosted
Self Hosted (Docker)
Steps to reproduce
In the dify-api container, curl http://192.168.0.6:9997/v1/models can get model info of Xinference

Then I add this model in dify as below
The web doesn't raise error, but I see the log in dify-api service, it shows connect timeout。 It seems that CredentialsValidateFailedError is related to Xinference plugin not my config. How to solve it?
✔️ Expected Behavior
No response
❌ Actual Behavior
No response
@dosubot[bot] commented on GitHub (Apr 9, 2025):
I found a similar unsolved discussion titled "Unable to save the model when deploying Dify using Docker, how to resolve the request timeout issue?" which might be relevant to your issue [1]. Additionally, there is a closed issue where upgrading the Xinference client to the latest version was suggested as a solution, along with checking a specific pull request [2].
For your specific issue, here are some troubleshooting steps you can try:
Network Configuration: Ensure that the Dify container can access the Xinference endpoint. You can verify this by executing a
curlcommand from within the Dify container to the Xinference server URL to check connectivity.Timeout Settings: Adjust the timeout settings in your environment configuration. You can set higher values for the connection and read timeouts to prevent timeout errors. This can be done by configuring environment variables such as
HTTP_REQUEST_MAX_CONNECT_TIMEOUTandHTTP_REQUEST_MAX_READ_TIMEOUT.Docker Network: Use
docker inspectto verify network connectivity between the Dify and Xinference containers. Ensure they are on the same network and can communicate with each other.Xinference Plugin: Check if there are any updates or patches available for the Xinference plugin that might address this issue.
These steps should help you diagnose and potentially resolve the connection timeout issue you're experiencing.
To continue talking to Dosu, mention @dosu.
Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Bug Report | Other