Dify cannot add the locally deployed fish-speech-1.5. #11854

Closed
opened 2026-02-21 19:04:23 -05:00 by yindo · 6 comments
Owner

Originally created by @zj2024 on GitHub (Mar 20, 2025).

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

Dify version

Version 0.15.3

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

  1. The fish-speech is deployed locally.
  2. The startup command of fish-speech:
    nohup python tools/api_server.py --compile --half >/data/logs/fish-speech-api-server.log 2>&1 &
  3. Add the fish-speech model in Dify.

Image

✔️ Expected Behavior

The model was added successfully.

Actual Behavior

{"statusCode":404,"message":null,"error":"Not Found"}

Originally created by @zj2024 on GitHub (Mar 20, 2025). ### Self Checks - [x] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [x] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [x] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:) - [x] Please do not modify this template :) and fill in all the required fields. ### Dify version Version 0.15.3 ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce 1. The fish-speech is deployed locally. 2. The startup command of fish-speech: nohup python tools/api_server.py --compile --half >/data/logs/fish-speech-api-server.log 2>&1 & 3. Add the fish-speech model in Dify. ![Image](https://github.com/user-attachments/assets/89ef18b3-0735-4c96-8a90-69711c593ca0) ### ✔️ Expected Behavior The model was added successfully. ### ❌ Actual Behavior {"statusCode":404,"message":null,"error":"Not Found"}
yindo closed this issue 2026-02-21 19:04:23 -05:00
Author
Owner

@crazywoola commented on GitHub (Mar 20, 2025):

Please upgrade to v1.1.0

@crazywoola commented on GitHub (Mar 20, 2025): Please upgrade to v1.1.0
Author
Owner

@zj2024 commented on GitHub (Mar 20, 2025):

Hello! Does this version not support this model? Does version v1.1.0 support this model?

@zj2024 commented on GitHub (Mar 20, 2025): Hello! Does this version not support this model? Does version v1.1.0 support this model?
Author
Owner

@dosubot[bot] commented on GitHub (Mar 20, 2025):

I found a similar closed issue where users faced problems adding OpenAI-compatible models. The issue was resolved by a pull request that fixed a bug related to adding such models [1]. Although the specific changes in the pull request are not detailed, it might be worth checking if your issue is related to a similar bug.

For your specific problem, the "Not Found" error (status code 404) typically indicates that the model does not exist or is not accessible at the specified API endpoint. Here are a few steps you can take to troubleshoot:

  1. Verify the API Endpoint: Ensure that the API endpoint URL (http://10.8.0.61:3003) is correct and accessible from the Dify environment. You can test this by accessing the URL directly from a browser or using a tool like curl to see if it responds as expected.

  2. Check Network Configuration: Make sure that the network settings allow Dify to communicate with the server hosting the fish-speech model. This includes checking firewall rules and Docker network configurations.

  3. API Key: If the model requires authentication, ensure that the API Key is correctly entered in the configuration interface.

  4. Model Compatibility: Confirm that the fish-speech model is compatible with the OpenAI API format expected by Dify.

If these steps do not resolve the issue, consider reviewing the Dify logs for more detailed error messages that might provide additional insights.

To continue talking to Dosu, mention @dosu.


Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Bug Report | Other

@dosubot[bot] commented on GitHub (Mar 20, 2025): <!-- Answer --> I found a similar closed issue where users faced problems adding OpenAI-compatible models. The issue was resolved by a pull request that fixed a bug related to adding such models <sup>[[1]](https://github.com/langgenius/dify/issues/8811)</sup>. Although the specific changes in the pull request are not detailed, it might be worth checking if your issue is related to a similar bug. For your specific problem, the "Not Found" error (status code 404) typically indicates that the model does not exist or is not accessible at the specified API endpoint. Here are a few steps you can take to troubleshoot: 1. **Verify the API Endpoint**: Ensure that the API endpoint URL (`http://10.8.0.61:3003`) is correct and accessible from the Dify environment. You can test this by accessing the URL directly from a browser or using a tool like `curl` to see if it responds as expected. 2. **Check Network Configuration**: Make sure that the network settings allow Dify to communicate with the server hosting the fish-speech model. This includes checking firewall rules and Docker network configurations. 3. **API Key**: If the model requires authentication, ensure that the API Key is correctly entered in the configuration interface. 4. **Model Compatibility**: Confirm that the fish-speech model is compatible with the OpenAI API format expected by Dify. If these steps do not resolve the issue, consider reviewing the Dify logs for more detailed error messages that might provide additional insights. <!-- Dosu Comment Footer --> *To continue talking to [Dosu](https://dosu.dev), mention @dosu.* --- <sup>Help Dosu learn! Give it feedback: [Great Response](https://app.dosu.dev/response-feedback/1b5ca4fd-132b-4908-931c-1c027bb8553f?feedback_type=great_response) | [Irrelevant Answer](https://app.dosu.dev/response-feedback/1b5ca4fd-132b-4908-931c-1c027bb8553f?feedback_type=irrelevant_answer) | [Incorrect Sources](https://app.dosu.dev/response-feedback/1b5ca4fd-132b-4908-931c-1c027bb8553f?feedback_type=incorrect_sources) | [Too Verbose](https://app.dosu.dev/response-feedback/1b5ca4fd-132b-4908-931c-1c027bb8553f?feedback_type=too_verbose) | [Hallucination](https://app.dosu.dev/response-feedback/1b5ca4fd-132b-4908-931c-1c027bb8553f?feedback_type=hallucination) | [Bug Report](https://app.dosu.dev/response-feedback/1b5ca4fd-132b-4908-931c-1c027bb8553f?feedback_type=bug_report) | [Other](https://app.dosu.dev/response-feedback/1b5ca4fd-132b-4908-931c-1c027bb8553f?feedback_type=other)</sup>
Author
Owner

@zj2024 commented on GitHub (Mar 20, 2025):

请升级到v1.1.0

Hello! Does this version not support this model? Does version v1.1.0 support this model?

@zj2024 commented on GitHub (Mar 20, 2025): > 请升级到v1.1.0 Hello! Does this version not support this model? Does version v1.1.0 support this model?
Author
Owner

@zj2024 commented on GitHub (Mar 20, 2025):

@crazywoola Hello! I have already upgraded to version 1.1.0, but the problem still persists. What information do I need to provide?

@zj2024 commented on GitHub (Mar 20, 2025): @crazywoola Hello! I have already upgraded to version 1.1.0, but the problem still persists. What information do I need to provide?
Author
Owner

@wilsonlv commented on GitHub (Apr 15, 2025):

@crazywoola Hello! I have already upgraded to version 1.1.0, but the problem still persists. What information do I need to provide?

Hello!Have you solved it yet?

@wilsonlv commented on GitHub (Apr 15, 2025): > [@crazywoola](https://github.com/crazywoola) Hello! I have already upgraded to version 1.1.0, but the problem still persists. What information do I need to provide? Hello!Have you solved it yet?
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#11854