LLM Model Provider issue after updating AWS Bedrock plugin version 0.0.17 #276

Closed
opened 2026-02-16 10:18:46 -05:00 by yindo · 4 comments
Owner

Originally created by @stephonye on GitHub (May 11, 2025).

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

Dify version

1.3.1

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

The previous version of the AWS Bedrock plugin was 0.0.13. We can get a list of 61 LLM models, including the embedding model for the knowledge base: cohere.embed-multilingual-v3. However, there is a problem when calling the knowledge base:

Image

0.0.13 LLM Models list:

Image

Therefore, we upgraded the AWS Bedrock plug-in from 0.0.13 to 0.0.17. At this time, there were only 12 LLM models left in the list, and our commonly used Anthropic Claude LLM models was no longer available. Moreover, errors still occurred when performing knowledge base operations.

0.0.17 LLM Models list:

Image

We use for AWS Bedrock's AWS Region is us-west-2, and the Dify setting is US West (Oregon)
API connection status is fine

✔️ Expected Behavior

The AWS Bedrock plugin can list the LLM models we have access to, mainly the Anthropic Claud model series. The knowledge base search can be used normally.

Actual Behavior

AWS Bedrock model list error and unable to embeding model using knowledge base cohere.embed-multilingual-v3

Originally created by @stephonye on GitHub (May 11, 2025). ### Self Checks - [x] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [x] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [x] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:) - [x] Please do not modify this template :) and fill in all the required fields. ### Dify version 1.3.1 ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce The previous version of the AWS Bedrock plugin was 0.0.13. We can get a list of 61 LLM models, including the embedding model for the knowledge base: cohere.embed-multilingual-v3. However, there is a problem when calling the knowledge base: <img width="346" alt="Image" src="https://github.com/user-attachments/assets/e2415a9a-76cf-4d09-8508-fa055db4c7f4" /> 0.0.13 LLM Models list: <img width="410" alt="Image" src="https://github.com/user-attachments/assets/7cc716d7-6a45-49de-a6f5-b4d4a5724c5a" /> Therefore, we upgraded the AWS Bedrock plug-in from 0.0.13 to 0.0.17. At this time, there were only 12 LLM models left in the list, and our commonly used Anthropic Claude LLM models was no longer available. Moreover, errors still occurred when performing knowledge base operations. 0.0.17 LLM Models list: <img width="407" alt="Image" src="https://github.com/user-attachments/assets/93194a38-5ea9-4301-afeb-6d9fb09af3f0" /> **We use for AWS Bedrock's AWS Region is us-west-2, and the Dify setting is US West (Oregon)** API connection status is fine ### ✔️ Expected Behavior The AWS Bedrock plugin can list the LLM models we have access to, mainly the Anthropic Claud model series. The knowledge base search can be used normally. ### ❌ Actual Behavior AWS Bedrock model list error and unable to embeding model using knowledge base cohere.embed-multilingual-v3
yindo closed this issue 2026-02-16 10:18:46 -05:00
Author
Owner

@dosubot[bot] commented on GitHub (May 11, 2025):

The issue you're experiencing with the AWS Bedrock plugin version 0.0.17 is related to the reduction in the number of available LLM models from 61 to 12, which includes the removal of the Anthropic Claude models. This change in the plugin version has affected your ability to access certain models, including those you commonly use, like the Anthropic Claude series [1].

Additionally, the error message indicating that the credentials for the model "rerank-multilingual-v3.0" are not initialized suggests a problem with model credential initialization. Dify handles model credential initialization by implementing the validate_credentials method, which ensures that credentials are correctly initialized and validated. If the credentials are not properly set up, it can lead to errors in workflow processes [2].

To resolve these issues, you may need to:

  1. Verify the credential setup for the models you are using, ensuring that they are correctly initialized according to the provider's configuration.
  2. Check if there are any updates or patches available for the AWS Bedrock plugin that might address the reduction in available models or credential initialization issues.
  3. Consider reverting to a previous version of the plugin if the changes in version 0.0.17 are causing significant disruptions to your workflow.

If these steps do not resolve the issue, further investigation into the plugin's configuration and compatibility with your specific AWS region settings may be necessary.

To continue talking to Dosu, mention @dosu.


Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Bug Report | Other

@dosubot[bot] commented on GitHub (May 11, 2025): <!-- Answer --> The issue you're experiencing with the AWS Bedrock plugin version 0.0.17 is related to the reduction in the number of available LLM models from 61 to 12, which includes the removal of the Anthropic Claude models. This change in the plugin version has affected your ability to access certain models, including those you commonly use, like the Anthropic Claude series <sup>[[1]](https://github.com/langgenius/dify/issues/19389)</sup>. Additionally, the error message indicating that the credentials for the model "rerank-multilingual-v3.0" are not initialized suggests a problem with model credential initialization. Dify handles model credential initialization by implementing the `validate_credentials` method, which ensures that credentials are correctly initialized and validated. If the credentials are not properly set up, it can lead to errors in workflow processes <sup>[[2]](https://github.com/crazywoola/dify-docs-mintlify/blob/main/plugin_dev_en/0412-model-schema.en.mdx)</sup>. To resolve these issues, you may need to: 1. Verify the credential setup for the models you are using, ensuring that they are correctly initialized according to the provider's configuration. 2. Check if there are any updates or patches available for the AWS Bedrock plugin that might address the reduction in available models or credential initialization issues. 3. Consider reverting to a previous version of the plugin if the changes in version 0.0.17 are causing significant disruptions to your workflow. If these steps do not resolve the issue, further investigation into the plugin's configuration and compatibility with your specific AWS region settings may be necessary. <!-- Dosu Comment Footer --> *To continue talking to [Dosu](https://dosu.dev), mention @dosu.* --- <sup>Help Dosu learn! Give it feedback: [Great Response](https://app.dosu.dev/response-feedback/1a3dee73-f72a-4393-9ebd-612163215f00?feedback_type=great_response) | [Irrelevant Answer](https://app.dosu.dev/response-feedback/1a3dee73-f72a-4393-9ebd-612163215f00?feedback_type=irrelevant_answer) | [Incorrect Sources](https://app.dosu.dev/response-feedback/1a3dee73-f72a-4393-9ebd-612163215f00?feedback_type=incorrect_sources) | [Too Verbose](https://app.dosu.dev/response-feedback/1a3dee73-f72a-4393-9ebd-612163215f00?feedback_type=too_verbose) | [Hallucination](https://app.dosu.dev/response-feedback/1a3dee73-f72a-4393-9ebd-612163215f00?feedback_type=hallucination) | [Bug Report](https://app.dosu.dev/response-feedback/1a3dee73-f72a-4393-9ebd-612163215f00?feedback_type=bug_report) | [Other](https://app.dosu.dev/response-feedback/1a3dee73-f72a-4393-9ebd-612163215f00?feedback_type=other)</sup>
Author
Owner

@stephonye commented on GitHub (May 12, 2025):

The issue you're experiencing with the AWS Bedrock plugin version 0.0.17 is related to the reduction in the number of available LLM models from 61 to 12, which includes the removal of the Anthropic Claude models. This change in the plugin version has affected your ability to access certain models, including those you commonly use, like the Anthropic Claude series [1].

Additionally, the error message indicating that the credentials for the model "rerank-multilingual-v3.0" are not initialized suggests a problem with model credential initialization. Dify handles model credential initialization by implementing the validate_credentials method, which ensures that credentials are correctly initialized and validated. If the credentials are not properly set up, it can lead to errors in workflow processes [2].

To resolve these issues, you may need to:

  1. Verify the credential setup for the models you are using, ensuring that they are correctly initialized according to the provider's configuration.
  2. Check if there are any updates or patches available for the AWS Bedrock plugin that might address the reduction in available models or credential initialization issues.
  3. Consider reverting to a previous version of the plugin if the changes in version 0.0.17 are causing significant disruptions to your workflow.

If these steps do not resolve the issue, further investigation into the plugin's configuration and compatibility with your specific AWS region settings may be necessary.

To continue talking to Dosu, mention @dosu.

Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Bug Report | Other

Thank you very much for your quick reply.

  1. I am very sure that there is no problem with AWS Bedrock's API credential authentication, because I can complete the settings in the model provider settings regardless of 0.0.13 or 0.0.17, and the correct model call in 0.0.13 returns the correct information, but currently cohere.embed-multilingual-v3 has an error.
  2. I tried all AWS Bedrock plugins from 0.0.12 to 0.0.17, and they all have the same problem.
  3. The description is the same as above.
@stephonye commented on GitHub (May 12, 2025): > The issue you're experiencing with the AWS Bedrock plugin version 0.0.17 is related to the reduction in the number of available LLM models from 61 to 12, which includes the removal of the Anthropic Claude models. This change in the plugin version has affected your ability to access certain models, including those you commonly use, like the Anthropic Claude series [[1]](https://github.com/langgenius/dify/issues/19389). > > Additionally, the error message indicating that the credentials for the model "rerank-multilingual-v3.0" are not initialized suggests a problem with model credential initialization. Dify handles model credential initialization by implementing the `validate_credentials` method, which ensures that credentials are correctly initialized and validated. If the credentials are not properly set up, it can lead to errors in workflow processes [[2]](https://github.com/crazywoola/dify-docs-mintlify/blob/main/plugin_dev_en/0412-model-schema.en.mdx). > > To resolve these issues, you may need to: > > 1. Verify the credential setup for the models you are using, ensuring that they are correctly initialized according to the provider's configuration. > 2. Check if there are any updates or patches available for the AWS Bedrock plugin that might address the reduction in available models or credential initialization issues. > 3. Consider reverting to a previous version of the plugin if the changes in version 0.0.17 are causing significant disruptions to your workflow. > > If these steps do not resolve the issue, further investigation into the plugin's configuration and compatibility with your specific AWS region settings may be necessary. > > _To continue talking to [Dosu](https://dosu.dev), mention [@dosu](https://github.com/dosu)._ > > Help Dosu learn! Give it feedback: [Great Response](https://app.dosu.dev/response-feedback/1a3dee73-f72a-4393-9ebd-612163215f00?feedback_type=great_response) | [Irrelevant Answer](https://app.dosu.dev/response-feedback/1a3dee73-f72a-4393-9ebd-612163215f00?feedback_type=irrelevant_answer) | [Incorrect Sources](https://app.dosu.dev/response-feedback/1a3dee73-f72a-4393-9ebd-612163215f00?feedback_type=incorrect_sources) | [Too Verbose](https://app.dosu.dev/response-feedback/1a3dee73-f72a-4393-9ebd-612163215f00?feedback_type=too_verbose) | [Hallucination](https://app.dosu.dev/response-feedback/1a3dee73-f72a-4393-9ebd-612163215f00?feedback_type=hallucination) | [Bug Report](https://app.dosu.dev/response-feedback/1a3dee73-f72a-4393-9ebd-612163215f00?feedback_type=bug_report) | [Other](https://app.dosu.dev/response-feedback/1a3dee73-f72a-4393-9ebd-612163215f00?feedback_type=other) Thank you very much for your quick reply. 1. I am very sure that there is no problem with AWS Bedrock's API credential authentication, because I can complete the settings in the model provider settings regardless of 0.0.13 or 0.0.17, and the correct model call in 0.0.13 returns the correct information, but currently cohere.embed-multilingual-v3 has an error. 2. I tried all AWS Bedrock plugins from 0.0.12 to 0.0.17, and they all have the same problem. 3. The description is the same as above.
Author
Owner

@stephonye commented on GitHub (May 12, 2025):

Supplementary verification information screenshot, this is version 0.0.17, the verification is correct, but there are only 12 LLM models in the Model List.

Image Image

This is version 0.0.13. The verification is correct, but there are 61 LLM models in the Model List, including the normally used Claude 3.5 Sonnet, etc.

Image Image
@stephonye commented on GitHub (May 12, 2025): Supplementary verification information screenshot, this is version 0.0.17, the verification is correct, but there are only 12 LLM models in the Model List. <img width="629" alt="Image" src="https://github.com/user-attachments/assets/0f70f593-a2fd-4e81-9500-e7a8bda67912" /> <img width="1083" alt="Image" src="https://github.com/user-attachments/assets/4e40a431-0f4d-417e-8453-e4173ac8cb0e" /> This is version 0.0.13. The verification is correct, but there are 61 LLM models in the Model List, including the normally used Claude 3.5 Sonnet, etc. <img width="624" alt="Image" src="https://github.com/user-attachments/assets/c98792ce-be74-4886-a83f-f80de06d72c0" /> <img width="1052" alt="Image" src="https://github.com/user-attachments/assets/c5ca6c05-3e0b-4e5a-ab3e-775be70aa635" />
Author
Owner

@gakugaku commented on GitHub (Jun 11, 2025):

@stephonye
Thank you for your help. I noticed that this issue was closed as "completed."
Could you please let me know whether the issue has been fixed, or if there was another reason for closing it?
I appreciate your clarification!

@gakugaku commented on GitHub (Jun 11, 2025): @stephonye Thank you for your help. I noticed that this issue was closed as "completed." Could you please let me know whether the issue has been fixed, or if there was another reason for closing it? I appreciate your clarification!
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify-official-plugins#276