Tongyi speech2text and tts models #294

Closed
opened 2026-02-16 10:18:50 -05:00 by yindo · 1 comment
Owner

Originally created by @Liu-Tianmeng on GitHub (May 19, 2025).

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

Dify version

1.4.0

Cloud or Self Hosted

Cloud

Steps to reproduce

Although I was prompted with “modified successfully,” the Tongyi card still cannot add the speech-to-text and TTS models.

✔️ Expected Behavior

I want to add Alibaba Cloud’s cosyvoice-v1 and paraformer-v2 models. Although I keep getting the message “modified successfully,” I still can’t find where the models are.

Image

If the models can’t be added, please don’t show a success message.

Actual Behavior

No response

Originally created by @Liu-Tianmeng on GitHub (May 19, 2025). ### Self Checks - [x] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [x] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [x] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:) - [x] Please do not modify this template :) and fill in all the required fields. ### Dify version 1.4.0 ### Cloud or Self Hosted Cloud ### Steps to reproduce Although I was prompted with “modified successfully,” the Tongyi card still cannot add the speech-to-text and TTS models. ### ✔️ Expected Behavior I want to add Alibaba Cloud’s cosyvoice-v1 and paraformer-v2 models. Although I keep getting the message “modified successfully,” I still can’t find where the models are. ![Image](https://github.com/user-attachments/assets/f5ef9dfc-4308-4bcf-b2b1-8fdeb5008e02) If the models can’t be added, please don’t show a success message. ### ❌ Actual Behavior _No response_
yindo closed this issue 2026-02-16 10:18:50 -05:00
Author
Owner

@dosubot[bot] commented on GitHub (May 19, 2025):

Hello @Liu-Tianmeng! 👋 I'm Dosu, your friendly bot here to help you solve bugs, answer questions, and assist you in becoming a contributor. I'm here while you wait for a human maintainer. Let's tackle this together! 😊

The issue you're experiencing, where the "modified successfully" message appears but the Tongyi models are not added, might be related to the conditions or checks implemented in the codebase for verifying the successful addition of a model. Here are some key checks that might be relevant:

  1. Credential Validation: Ensure that the replicate_api_token is correctly set in the credentials. If this token is missing, the model addition process might fail without proper notification.

  2. Model Name Format: The model name should be in the format {user_name}/{model_name}. If the format is incorrect, it could lead to a failure in adding the model.

  3. Model Existence: The system attempts to retrieve model information using the ReplicateClient. If the model or its version does not exist, it might fail silently, leading to the issue you're seeing.

  4. Text Generation Model Check: The model should meet specific criteria, such as being a text generation model with certain properties (temperature, top_p, top_k). If these are not met, the addition might not be successful.

These checks are part of the logic that ensures models are added correctly [1]. You might want to verify these conditions in your setup to ensure the models are added successfully. If these checks are met and the issue persists, it might require further investigation into the code handling model additions.

To continue talking to Dosu, mention @dosu.


Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Bug Report | Other

@dosubot[bot] commented on GitHub (May 19, 2025): <!-- Greeting --> Hello @Liu-Tianmeng! 👋 I'm [Dosu](https://dosu.dev), your friendly bot here to help you solve bugs, answer questions, and assist you in becoming a contributor. I'm here while you wait for a human maintainer. Let's tackle this together! 😊 <!-- Answer --> The issue you're experiencing, where the "modified successfully" message appears but the Tongyi models are not added, might be related to the conditions or checks implemented in the codebase for verifying the successful addition of a model. Here are some key checks that might be relevant: 1. **Credential Validation**: Ensure that the `replicate_api_token` is correctly set in the credentials. If this token is missing, the model addition process might fail without proper notification. 2. **Model Name Format**: The model name should be in the format `{user_name}/{model_name}`. If the format is incorrect, it could lead to a failure in adding the model. 3. **Model Existence**: The system attempts to retrieve model information using the `ReplicateClient`. If the model or its version does not exist, it might fail silently, leading to the issue you're seeing. 4. **Text Generation Model Check**: The model should meet specific criteria, such as being a text generation model with certain properties (`temperature`, `top_p`, `top_k`). If these are not met, the addition might not be successful. These checks are part of the logic that ensures models are added correctly <sup>[[1]](https://github.com/langgenius/dify/blob/main/api/core/model_runtime/model_providers/replicate/llm/llm.py)</sup>. You might want to verify these conditions in your setup to ensure the models are added successfully. If these checks are met and the issue persists, it might require further investigation into the code handling model additions. <!-- Dosu Comment Footer --> *To continue talking to [Dosu](https://dosu.dev), mention @dosu.* --- <sup>Help Dosu learn! Give it feedback: [Great Response](https://app.dosu.dev/response-feedback/2c92ac45-ddb3-4d2a-a870-c7538bb7854d?feedback_type=great_response) | [Irrelevant Answer](https://app.dosu.dev/response-feedback/2c92ac45-ddb3-4d2a-a870-c7538bb7854d?feedback_type=irrelevant_answer) | [Incorrect Sources](https://app.dosu.dev/response-feedback/2c92ac45-ddb3-4d2a-a870-c7538bb7854d?feedback_type=incorrect_sources) | [Too Verbose](https://app.dosu.dev/response-feedback/2c92ac45-ddb3-4d2a-a870-c7538bb7854d?feedback_type=too_verbose) | [Hallucination](https://app.dosu.dev/response-feedback/2c92ac45-ddb3-4d2a-a870-c7538bb7854d?feedback_type=hallucination) | [Bug Report](https://app.dosu.dev/response-feedback/2c92ac45-ddb3-4d2a-a870-c7538bb7854d?feedback_type=bug_report) | [Other](https://app.dosu.dev/response-feedback/2c92ac45-ddb3-4d2a-a870-c7538bb7854d?feedback_type=other)</sup>
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify-official-plugins#294