Add ranker model by Xinference plugin timeout #180

Closed
opened 2026-02-16 10:18:21 -05:00 by yindo · 2 comments
Owner

Originally created by @cainiaodidi on GitHub (Apr 8, 2025).

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

Dify version

1.1.3

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

In the dify-api container, curl http://192.168.0.6:9997/v1/models can get model info of Xinference
Image

Then I add this model in dify as below
Image

The web doesn't raise error, but I see the log in dify-api service, it shows connect timeout。 It seems that CredentialsValidateFailedError is related to Xinference plugin not my config. How to solve it?
Image

✔️ Expected Behavior

No response

Actual Behavior

No response

Originally created by @cainiaodidi on GitHub (Apr 8, 2025). ### Self Checks - [x] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [x] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [x] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:) - [x] Please do not modify this template :) and fill in all the required fields. ### Dify version 1.1.3 ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce In the dify-api container, `curl http://192.168.0.6:9997/v1/models` can get model info of Xinference ![Image](https://github.com/user-attachments/assets/ffc4d37c-178a-4bc4-9f29-591de3600459) Then I add this model in dify as below ![Image](https://github.com/user-attachments/assets/a8b2f575-462e-46ac-ad76-eaccc8a20978) The web doesn't raise error, but I see the log in dify-api service, it shows connect timeout。 **It seems that CredentialsValidateFailedError is related to Xinference plugin not my config**. How to solve it? <img width="1385" alt="Image" src="https://github.com/user-attachments/assets/4e6ff8aa-0d8a-4dc7-a2ef-b1e3c7922a91" /> ### ✔️ Expected Behavior _No response_ ### ❌ Actual Behavior _No response_
yindo closed this issue 2026-02-16 10:18:21 -05:00
Author
Owner

@dosubot[bot] commented on GitHub (Apr 8, 2025):

I found a similar issue related to connection timeouts when using the Xinference plugin with Dify. Here are some suggested troubleshooting steps that might help resolve the timeout issue:

  1. Increase the Timeout Period: You can increase the timeout period by adding the following to your docker-compose.yaml file under the plugin_daemon service:

    plugin_daemon:
      environment:
        PYTHON_ENV_INIT_TIMEOUT: 320
    
  2. File System Considerations: If you are using Docker on Windows, consider moving the dify/docker directory to the WSL filesystem instead of Windows NTFS to improve performance.

  3. Set Plugin Working Path: Add the following environment variable to your .env file:

    PLUGIN_WORKING_PATH=/app/cwd
    
  4. Use a Mirror URL for Internal Networks: If you are on an internal network, set PIP_MIRROR_URL in plugin_daemon to use a mirror URL (e.g., https://pypi.tuna.tsinghua.edu.cn/simple) to improve installation speed [1].

These steps should help address the connection timeout issue you are experiencing with the Xinference plugin.

To continue talking to Dosu, mention @dosu.


Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Bug Report | Other

@dosubot[bot] commented on GitHub (Apr 8, 2025): <!-- Answer --> I found a similar issue related to connection timeouts when using the Xinference plugin with Dify. Here are some suggested troubleshooting steps that might help resolve the timeout issue: 1. **Increase the Timeout Period**: You can increase the timeout period by adding the following to your `docker-compose.yaml` file under the `plugin_daemon` service: ```yaml plugin_daemon: environment: PYTHON_ENV_INIT_TIMEOUT: 320 ``` 2. **File System Considerations**: If you are using Docker on Windows, consider moving the `dify/docker` directory to the WSL filesystem instead of Windows NTFS to improve performance. 3. **Set Plugin Working Path**: Add the following environment variable to your `.env` file: ``` PLUGIN_WORKING_PATH=/app/cwd ``` 4. **Use a Mirror URL for Internal Networks**: If you are on an internal network, set `PIP_MIRROR_URL` in `plugin_daemon` to use a mirror URL (e.g., `https://pypi.tuna.tsinghua.edu.cn/simple`) to improve installation speed <sup>[[1]](https://github.com/langgenius/dify/issues/15288)</sup>. These steps should help address the connection timeout issue you are experiencing with the Xinference plugin. <!-- Dosu Comment Footer --> *To continue talking to [Dosu](https://dosu.dev), mention @dosu.* --- <sup>Help Dosu learn! Give it feedback: [Great Response](https://app.dosu.dev/response-feedback/cdec4c5e-577e-464c-8d4b-8ecaba5246c9?feedback_type=great_response) | [Irrelevant Answer](https://app.dosu.dev/response-feedback/cdec4c5e-577e-464c-8d4b-8ecaba5246c9?feedback_type=irrelevant_answer) | [Incorrect Sources](https://app.dosu.dev/response-feedback/cdec4c5e-577e-464c-8d4b-8ecaba5246c9?feedback_type=incorrect_sources) | [Too Verbose](https://app.dosu.dev/response-feedback/cdec4c5e-577e-464c-8d4b-8ecaba5246c9?feedback_type=too_verbose) | [Hallucination](https://app.dosu.dev/response-feedback/cdec4c5e-577e-464c-8d4b-8ecaba5246c9?feedback_type=hallucination) | [Bug Report](https://app.dosu.dev/response-feedback/cdec4c5e-577e-464c-8d4b-8ecaba5246c9?feedback_type=bug_report) | [Other](https://app.dosu.dev/response-feedback/cdec4c5e-577e-464c-8d4b-8ecaba5246c9?feedback_type=other)</sup>
Author
Owner

@cainiaodidi commented on GitHub (Apr 9, 2025):

@dosu these methods seem that solve installing problems of Xinference plugin, not solve my problem

@cainiaodidi commented on GitHub (Apr 9, 2025): @dosu these methods seem that solve installing problems of Xinference plugin, not solve my problem
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify-official-plugins#180