langgenius/dify-official-plugins
1
0
Fork 0
mirror of https://github.com/langgenius/dify-official-plugins.git synced 2026-07-22 01:55:27 -04:00
Code Issues 54 Packages Projects Releases Wiki Activity

[PR #767] [MERGED] Feat/bedrock prompt cache #1541

New Issue
Closed
opened 2026-02-16 10:23:15 -05:00 by yindo · 0 comments
yindo commented 2026-02-16 10:23:15 -05:00
Owner
Copy Link
Copy Source

📋 Pull Request Information

Original PR: https://github.com/langgenius/dify-official-plugins/pull/767
Author: @warren830
Created: 4/21/2025
Status: ✅ Merged
Merged: 4/22/2025
Merged by: @crazywoola

Base: main ← Head: feat/bedrock-prompt-cache

📝 Commits (3)

  • efb6054 support bedrock prompt cache
  • b2c3ff4 fix: sdk version
  • c1ec953 Update models/bedrock/models/llm/cache_config.py

📊 Changes

17 files changed (+771 additions, -107 deletions)

View changed files

➕ models/bedrock/_assets/configure.png (+0 -0)
📝 models/bedrock/manifest.yaml (+2 -2)
📝 models/bedrock/models/llm/amazon.nova-lite-v1.yaml (+10 -0)
📝 models/bedrock/models/llm/amazon.nova-micro-v1.yaml (+14 -3)
📝 models/bedrock/models/llm/amazon.nova-pro-v1.yaml (+12 -2)
📝 models/bedrock/models/llm/anthropic.claude-3-5-haiku-v1.yaml (+15 -5)
➕ models/bedrock/models/llm/cache_config.py (+138 -0)
📝 models/bedrock/models/llm/llm.py (+526 -74)
📝 models/bedrock/models/llm/us.amazon.nova-lite-v1.yaml (+10 -0)
📝 models/bedrock/models/llm/us.amazon.nova-micro-v1.yaml (+10 -0)
📝 models/bedrock/models/llm/us.amazon.nova-pro-v1.yaml (+10 -0)
📝 models/bedrock/models/llm/us.anthropic.claude-3-5-haiku-v1.yaml (+10 -0)
📝 models/bedrock/models/llm/us.anthropic.claude-3-7-sonnet-v1.0.yaml (+10 -0)
📝 models/bedrock/provider/bedrock.py (+0 -0)
📝 models/bedrock/provider/bedrock.yaml (+2 -13)
📝 models/bedrock/provider/get_bedrock_client.py (+0 -6)
📝 models/bedrock/requirements.txt (+2 -2)

📄 Description

This is from log:
2025-04-19 17:05:10,570 - models.llm.llm - INFO - Cache metrics - Model: us.anthropic.claude-3-7-sonnet-20250219-v1:0, Read: 0 tokens, Write: 1908 tokens
[STREAM CACHE WRITE] 1908 tokens written to cache
2025-04-19 17:05:10,570 - models.llm.llm - INFO - Cache write detected - 1908 tokens written to cache

we can see that cache has been enabled.

Related Issues or Context

This PR contains Changes to Non-Plugin

  • Documentation
  • Other

This PR contains Changes to Non-LLM Models Plugin

  • I have Run Comprehensive Tests Relevant to My Changes

This PR contains Changes to LLM Models Plugin

  • My Changes Affect Message Flow Handling (System Messages and User→Assistant Turn-Taking)
  • My Changes Affect Tool Interaction Flow (Multi-Round Usage and Output Handling, for both Agent App and Agent Node)
  • My Changes Affect Multimodal Input Handling (Images, PDFs, Audio, Video, etc.)
  • My Changes Affect Multimodal Output Generation (Images, Audio, Video, etc.)
  • My Changes Affect Structured Output Format (JSON, XML, etc.)
  • My Changes Affect Token Consumption Metrics
  • My Changes Affect Other LLM Functionalities (Reasoning Process, Grounding, Prompt Caching, etc.)
  • Other Changes (Add New Models, etc.)

Version Control (Any Changes to the Plugin Will Require Bumping the Version)

  • I have Bumped Up the Version in Manifest.yaml (Top-Level Version Field, Not in Meta Section)

Dify Plugin SDK Version

  • I'm Using dify_plugin>=0.1.0,<0.2.0 in requirements.txt (SDK docs)

Environment Verification (If Any Code Changes)

Local Deployment Environment

  • Dify Version is: , I have Tested My Changes on Local Deployment Dify with a Clean Environment That Matches the Production Configuration.

SaaS Environment

  • I have Tested My Changes on cloud.dify.ai with a Clean Environment That Matches the Production Configuration

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/langgenius/dify-official-plugins/pull/767 **Author:** [@warren830](https://github.com/warren830) **Created:** 4/21/2025 **Status:** ✅ Merged **Merged:** 4/22/2025 **Merged by:** [@crazywoola](https://github.com/crazywoola) **Base:** `main` ← **Head:** `feat/bedrock-prompt-cache` --- ### 📝 Commits (3) - [`efb6054`](https://github.com/langgenius/dify-official-plugins/commit/efb6054d07e3c474d7dcca231550b3c5ae710549) support bedrock prompt cache - [`b2c3ff4`](https://github.com/langgenius/dify-official-plugins/commit/b2c3ff4a5f8e862f9dc4e7cdba50dc41396a1e6a) fix: sdk version - [`c1ec953`](https://github.com/langgenius/dify-official-plugins/commit/c1ec9538ec94f9916f26a2872142301fc10ef533) Update models/bedrock/models/llm/cache_config.py ### 📊 Changes **17 files changed** (+771 additions, -107 deletions) <details> <summary>View changed files</summary> ➕ `models/bedrock/_assets/configure.png` (+0 -0) 📝 `models/bedrock/manifest.yaml` (+2 -2) 📝 `models/bedrock/models/llm/amazon.nova-lite-v1.yaml` (+10 -0) 📝 `models/bedrock/models/llm/amazon.nova-micro-v1.yaml` (+14 -3) 📝 `models/bedrock/models/llm/amazon.nova-pro-v1.yaml` (+12 -2) 📝 `models/bedrock/models/llm/anthropic.claude-3-5-haiku-v1.yaml` (+15 -5) ➕ `models/bedrock/models/llm/cache_config.py` (+138 -0) 📝 `models/bedrock/models/llm/llm.py` (+526 -74) 📝 `models/bedrock/models/llm/us.amazon.nova-lite-v1.yaml` (+10 -0) 📝 `models/bedrock/models/llm/us.amazon.nova-micro-v1.yaml` (+10 -0) 📝 `models/bedrock/models/llm/us.amazon.nova-pro-v1.yaml` (+10 -0) 📝 `models/bedrock/models/llm/us.anthropic.claude-3-5-haiku-v1.yaml` (+10 -0) 📝 `models/bedrock/models/llm/us.anthropic.claude-3-7-sonnet-v1.0.yaml` (+10 -0) 📝 `models/bedrock/provider/bedrock.py` (+0 -0) 📝 `models/bedrock/provider/bedrock.yaml` (+2 -13) 📝 `models/bedrock/provider/get_bedrock_client.py` (+0 -6) 📝 `models/bedrock/requirements.txt` (+2 -2) </details> ### 📄 Description This is from log: 2025-04-19 17:05:10,570 - models.llm.llm - INFO - Cache metrics - Model: us.anthropic.claude-3-7-sonnet-20250219-v1:0, Read: 0 tokens, Write: 1908 tokens [STREAM CACHE WRITE] 1908 tokens written to cache 2025-04-19 17:05:10,570 - models.llm.llm - INFO - Cache write detected - 1908 tokens written to cache we can see that cache has been enabled. ## Related Issues or Context <!-- ⚠️ NOTE: This repository is for Dify Official Plugins only. For community contributions, please submit to https://github.com/langgenius/dify-plugins instead. - Link Related Issues if Applicable: #issue_number - Or Provide Context about Why this Change is Needed --> ## This PR contains Changes to *Non-Plugin* <!-- Put an `x` in all the boxes that apply by replacing [ ] with [x] For example: - [x] Documentation --> - [ ] Documentation - [ ] Other ## This PR contains Changes to *Non-LLM Models Plugin* - [x] I have Run Comprehensive Tests Relevant to My Changes <!-- 📷 Include Screenshots/Videos Demonstrating the Fix, New Feature, or the Behavior Before/After Breaking Changes. --> ## This PR contains Changes to *LLM Models Plugin* <!-- LLM Models Test Example: --> <!-- https://github.com/langgenius/dify-official-plugins/blob/main/.assets/test-examples/llm-plugin-tests/llm_test_example.md --> - [ ] My Changes Affect Message Flow Handling (System Messages and User→Assistant Turn-Taking) <!-- 📷 Include Screenshots/Videos Demonstrating the Fix, New Feature, or the Behavior Before/After Breaking Changes. --> - [ ] My Changes Affect Tool Interaction Flow (Multi-Round Usage and Output Handling, for both Agent App and Agent Node) <!-- 📷 Include Screenshots/Videos Demonstrating the Fix, New Feature, or the Behavior Before/After Breaking Changes. --> - [ ] My Changes Affect Multimodal Input Handling (Images, PDFs, Audio, Video, etc.) <!-- 📷 Include Screenshots/Videos Demonstrating the Fix, New Feature, or the Behavior Before/After Breaking Changes. --> - [ ] My Changes Affect Multimodal Output Generation (Images, Audio, Video, etc.) <!-- 📷 Include Screenshots/Videos Demonstrating the Fix, New Feature, or the Behavior Before/After Breaking Changes. --> - [ ] My Changes Affect Structured Output Format (JSON, XML, etc.) <!-- 📷 Include Screenshots/Videos Demonstrating the Fix, New Feature, or the Behavior Before/After Breaking Changes. --> - [ ] My Changes Affect Token Consumption Metrics <!-- 📷 Include Screenshots/Videos Demonstrating the Fix, New Feature, or the Behavior Before/After Breaking Changes. --> - [ ] My Changes Affect Other LLM Functionalities (Reasoning Process, Grounding, Prompt Caching, etc.) <!-- 📷 Include Screenshots/Videos Demonstrating the Fix, New Feature, or the Behavior Before/After Breaking Changes. --> - [ ] Other Changes (Add New Models, etc.) <!-- 📷 Include Screenshots/Videos Demonstrating the Fix, New Feature, or the Behavior Before/After Breaking Changes. --> ## Version Control (Any Changes to the Plugin Will Require Bumping the Version) - [ ] I have Bumped Up the Version in Manifest.yaml (Top-Level `Version` Field, Not in Meta Section) <!-- ⚠️ NOTE: Version Format: MAJOR.MINOR.PATCH - MAJOR (0.x.x): Reserved for Significant architectural changes or incompatible API modifications - MINOR (x.0.x): For New feature additions while maintaining backward compatibility - PATCH (x.x.0): For Backward-compatible bug fixes and minor improvements - Note: Each Version Component (MAJOR, MINOR, PATCH) Can Be 2 Digits, e.g., 10.11.22 --> ## Dify Plugin SDK Version - [x] I'm Using `dify_plugin>=0.1.0,<0.2.0` in requirements.txt ([SDK docs](https://github.com/langgenius/dify-plugin-sdks/blob/main/python/README.md)) ## Environment Verification (If Any Code Changes) <!-- ⚠️ NOTE: At Least One Environment Must Be Tested. --> ### Local Deployment Environment - [ ] Dify Version is: <!-- Specify Your Version (e.g., 1.2.0) -->, I have Tested My Changes on Local Deployment Dify with a Clean Environment That Matches the Production Configuration. <!-- - Python Virtual Env Matching Manifest.yaml & requirements.txt - No Breaking Changes in Dify That May Affect the Testing Result --> ### SaaS Environment - [ ] I have Tested My Changes on cloud.dify.ai with a Clean Environment That Matches the Production Configuration <!-- - Python Virtual Env Matching Manifest.yaml & requirements.txt --> --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-16 10:23:15 -05:00
yindo closed this issue 2026-02-16 10:23:15 -05:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
bug
bug
dependencies
documentation
enhancement
good first issue
invalid
pull-request
Mirrored from GitHub Pull Request
 question
stale
No Label pull-request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify-official-plugins#1541
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?