question classifier doesn't work with anthropic model(bedrock) #6352

Closed
opened 2026-02-21 18:15:21 -05:00 by yindo · 2 comments
Owner

Originally created by @ybalbert001 on GitHub (Oct 26, 2024).

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

Dify version

0.10.1

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

use claude3 haiku as question classifier model
Screenshot 2024-10-26 at 13 12 38

✔️ Expected Behavior

Don't throw error when using question classifier

Actual Behavior

throw error

Originally created by @ybalbert001 on GitHub (Oct 26, 2024). ### Self Checks - [X] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [X] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [X] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [X] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:) - [X] Please do not modify this template :) and fill in all the required fields. ### Dify version 0.10.1 ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce use claude3 haiku as question classifier model <img width="869" alt="Screenshot 2024-10-26 at 13 12 38" src="https://github.com/user-attachments/assets/516f761d-68b6-4843-9ce7-1bc138e24739"> ### ✔️ Expected Behavior Don't throw error when using question classifier ### ❌ Actual Behavior throw error
yindo added the 🐞 bug label 2026-02-21 18:15:21 -05:00
yindo closed this issue 2026-02-21 18:15:21 -05:00
Author
Owner

@dosubot[bot] commented on GitHub (Oct 26, 2024):

I found a similar unsolved discussion titled Question Classification function in workflow maybe abnormal which might be related to the issue you're experiencing [1]. Unfortunately, there isn't a documented solution available for this specific problem.

Regarding your issue with the question classifier not working with the Anthropic model (Bedrock) and the "ValidationException" error, there isn't specific information available in the repository about this error or its conditions. It might be helpful to check the configuration settings for the Claude 3 Haiku model to ensure everything is set up correctly. You can find these settings in the us.anthropic.claude-3-haiku-20240307-v1.yaml file, which includes parameters like max_tokens, temperature, top_p, and top_k [2][3][4][5].

If the issue persists, consider reviewing the configuration and ensuring that the conversation roles between user and assistant are correctly alternated, as this might be related to the error message you're encountering.

To continue talking to Dosu, mention @dosu.

@dosubot[bot] commented on GitHub (Oct 26, 2024): <!-- Answer --> I found a similar unsolved discussion titled [Question Classification function in workflow maybe abnormal](https://github.com/langgenius/dify/discussions/8430) which might be related to the issue you're experiencing <sup>[[1]](https://github.com/langgenius/dify/discussions/8430)</sup>. Unfortunately, there isn't a documented solution available for this specific problem. Regarding your issue with the question classifier not working with the Anthropic model (Bedrock) and the "ValidationException" error, there isn't specific information available in the repository about this error or its conditions. It might be helpful to check the configuration settings for the Claude 3 Haiku model to ensure everything is set up correctly. You can find these settings in the `us.anthropic.claude-3-haiku-20240307-v1.yaml` file, which includes parameters like `max_tokens`, `temperature`, `top_p`, and `top_k` <sup>[[2]](https://github.com/langgenius/dify/blob/main/api/core/model_runtime/model_providers/openrouter/llm/claude-3-haiku.yaml)</sup><sup>[[3]](https://github.com/langgenius/dify/blob/main/api/core/model_runtime/model_providers/anthropic/llm/claude-3-haiku-20240307.yaml)</sup><sup>[[4]](https://github.com/langgenius/dify/blob/main/api/core/model_runtime/model_providers/vertex_ai/llm/anthropic.claude-3-haiku.yaml)</sup><sup>[[5]](https://github.com/langgenius/dify/blob/main/api/core/model_runtime/model_providers/bedrock/llm/us.anthropic.claude-3-haiku-v1.yaml)</sup>. If the issue persists, consider reviewing the configuration and ensuring that the conversation roles between user and assistant are correctly alternated, as this might be related to the error message you're encountering. <!-- Dosu Comment Footer --> *To continue talking to [Dosu](https://dosu.dev), mention @dosu.*
Author
Owner

@crazywoola commented on GitHub (Oct 26, 2024):

Duplicated https://github.com/langgenius/dify/issues/9764

@crazywoola commented on GitHub (Oct 26, 2024): Duplicated https://github.com/langgenius/dify/issues/9764
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#6352