Haiku 4.5 does not appear to be prompt caching properly #758

Closed
opened 2026-02-16 10:20:24 -05:00 by yindo · 1 comment
Owner

Originally created by @webdepsbl on GitHub (Oct 28, 2025).

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues Dify issues & Dify Official Plugins, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

Dify version

1.9.2

Plugin version

0.2.2

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

  1. Create a Chatflow with an Agent using Haiku 4.5. Set "Cache System Message" and "Cache Tool Definitions" to true.
  2. Give it instructions wrapped in <cache></cache> tags.
  3. Do a number of test chats to generate usage stats in the Claude Console (https://console.anthropic.com/usage). Observe the cache rate table. It show's a 0% Cache Rate.

Switching model to Haiku 3.5, repeat the same process. It will show a cache rate greater than 0%, and appears to be operating as intended.

I am self hosting using Docker. I am not seeing any logs to further debug this issue.

✔️ Error log

No response

Originally created by @webdepsbl on GitHub (Oct 28, 2025). ### Self Checks - [x] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [x] I have searched for existing issues [Dify issues](https://github.com/langgenius/dify/issues) & [Dify Official Plugins](https://github.com/langgenius/dify-official-plugins/issues), including closed ones. - [x] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:) - [x] Please do not modify this template :) and fill in all the required fields. ### Dify version 1.9.2 ### Plugin version 0.2.2 ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce 1. Create a Chatflow with an Agent using Haiku 4.5. Set "Cache System Message" and "Cache Tool Definitions" to `true`. 2. Give it instructions wrapped in `<cache></cache>` tags. 3. Do a number of test chats to generate usage stats in the Claude Console (https://console.anthropic.com/usage). Observe the cache rate table. It show's a 0% Cache Rate. Switching model to Haiku 3.5, repeat the same process. It will show a cache rate greater than 0%, and appears to be operating as intended. I am self hosting using Docker. I am not seeing any logs to further debug this issue. ### ✔️ Error log _No response_
yindo added the bug label 2026-02-16 10:20:24 -05:00
yindo closed this issue 2026-02-16 10:20:24 -05:00
Author
Owner

@dosubot[bot] commented on GitHub (Nov 13, 2025):

Hi, @webdepsbl. I'm Dosu, and I'm helping the dify-official-plugins team manage their backlog and am marking this issue as stale.

Issue Summary:

  • You reported that prompt caching does not work with Haiku 4.5 in a self-hosted Docker setup.
  • The cache rate remains at 0% for Haiku 4.5, while Haiku 3.5 shows proper caching above 0%.
  • The problem appears specific to Haiku 4.5.
  • No error logs are available to help diagnose the issue.
  • There has been no further activity or comments on this issue.

Next Steps:

  • Please let me know if this issue is still relevant with the latest version of dify-official-plugins by commenting here.
  • If I do not hear back within 5 days, I will automatically close this issue.

Thank you for your understanding and contribution!

@dosubot[bot] commented on GitHub (Nov 13, 2025): Hi, @webdepsbl. I'm [Dosu](https://dosu.dev), and I'm helping the dify-official-plugins team manage their backlog and am marking this issue as stale. **Issue Summary:** - You reported that prompt caching does not work with Haiku 4.5 in a self-hosted Docker setup. - The cache rate remains at 0% for Haiku 4.5, while Haiku 3.5 shows proper caching above 0%. - The problem appears specific to Haiku 4.5. - No error logs are available to help diagnose the issue. - There has been no further activity or comments on this issue. **Next Steps:** - Please let me know if this issue is still relevant with the latest version of dify-official-plugins by commenting here. - If I do not hear back within 5 days, I will automatically close this issue. Thank you for your understanding and contribution!
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify-official-plugins#758