Error using Claude 3.5 sonnet with tool use #13193

Closed
opened 2026-02-21 19:11:01 -05:00 by yindo · 5 comments
Owner

Originally created by @harrywang on GitHub (Apr 21, 2025).

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

Dify version

v1.2.0

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

The following error pops up when talking to agent after using knowledge and tavily search:
Image

Image

✔️ Expected Behavior

no error and generate response

Actual Behavior

error msg.

Originally created by @harrywang on GitHub (Apr 21, 2025). ### Self Checks - [x] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [x] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [x] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:) - [x] Please do not modify this template :) and fill in all the required fields. ### Dify version v1.2.0 ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce The following error pops up when talking to agent after using knowledge and tavily search: <img width="2291" alt="Image" src="https://github.com/user-attachments/assets/73841f3a-f5b2-42d1-8a1e-0fd04cc4a620" /> <img width="2278" alt="Image" src="https://github.com/user-attachments/assets/0b61ed3b-8cbc-4e47-8644-24683257095b" /> ### ✔️ Expected Behavior no error and generate response ### ❌ Actual Behavior error msg.
yindo added the 🤖 feat:agent🔨 feat:tools labels 2026-02-21 19:11:01 -05:00
yindo closed this issue 2026-02-21 19:11:01 -05:00
Author
Owner

@dosubot[bot] commented on GitHub (Apr 21, 2025):

Use 'anthropic/claude-3.5-sonnet:beta' as your custom OpenRouter model instead of 'anthropic/claude-3.5-sonnet'. The ':beta' version always routes to Anthropic directly and never to Amazon Bedrock, avoiding the tool processing issues that occur when requests are routed through Amazon Bedrock [1].

To continue talking to Dosu, mention @dosu.


Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Bug Report | Other

@dosubot[bot] commented on GitHub (Apr 21, 2025): <!-- Answer --> Use 'anthropic/claude-3.5-sonnet:beta' as your custom OpenRouter model instead of 'anthropic/claude-3.5-sonnet'. The ':beta' version always routes to Anthropic directly and never to Amazon Bedrock, avoiding the tool processing issues that occur when requests are routed through Amazon Bedrock <sup>[[1]](https://github.com/langgenius/dify/issues/13772)</sup>. <!-- Dosu Comment Footer --> *To continue talking to [Dosu](https://dosu.dev), mention @dosu.* --- <sup>Help Dosu learn! Give it feedback: [Great Response](https://app.dosu.dev/response-feedback/042c18f1-891b-4bad-9d5d-f0475d51d555?feedback_type=great_response) | [Irrelevant Answer](https://app.dosu.dev/response-feedback/042c18f1-891b-4bad-9d5d-f0475d51d555?feedback_type=irrelevant_answer) | [Incorrect Sources](https://app.dosu.dev/response-feedback/042c18f1-891b-4bad-9d5d-f0475d51d555?feedback_type=incorrect_sources) | [Too Verbose](https://app.dosu.dev/response-feedback/042c18f1-891b-4bad-9d5d-f0475d51d555?feedback_type=too_verbose) | [Hallucination](https://app.dosu.dev/response-feedback/042c18f1-891b-4bad-9d5d-f0475d51d555?feedback_type=hallucination) | [Bug Report](https://app.dosu.dev/response-feedback/042c18f1-891b-4bad-9d5d-f0475d51d555?feedback_type=bug_report) | [Other](https://app.dosu.dev/response-feedback/042c18f1-891b-4bad-9d5d-f0475d51d555?feedback_type=other)</sup>
Author
Owner

@Rain-H commented on GitHub (Apr 22, 2025):

it works fine when user just use chat, but it will pop up error message after using knowledge

Image

Image
@Rain-H commented on GitHub (Apr 22, 2025): it works fine when user just use chat, but it will pop up error message after using knowledge ![Image](https://github.com/user-attachments/assets/e20ee5cf-3759-4bb0-9f90-73b90d352261) <img width="1488" alt="Image" src="https://github.com/user-attachments/assets/3a6daa19-68ac-4e12-a634-fc2f7aa3c1bb" />
Author
Owner

@fdb02983rhy commented on GitHub (Apr 26, 2025):

Whats your plugin version?

@fdb02983rhy commented on GitHub (Apr 26, 2025): Whats your plugin version?
Author
Owner

@harrywang commented on GitHub (Apr 26, 2025):

Whats your plugin version?

0.04

Image

Let me try to upgrade

@harrywang commented on GitHub (Apr 26, 2025): > Whats your plugin version? 0.04 <img width="422" alt="Image" src="https://github.com/user-attachments/assets/3d404d88-5c9d-456d-95a8-c0cf4bcd3592" /> Let me try to upgrade
Author
Owner

@harrywang commented on GitHub (Apr 26, 2025):

problem solved after upgrading to 0.0.13.

@harrywang commented on GitHub (Apr 26, 2025): problem solved after upgrading to 0.0.13.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#13193