[PR #2207] [MERGED] Feat/support multimodal embedding and reranking #2323

Closed
opened 2026-02-16 11:16:41 -05:00 by yindo · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/langgenius/dify-official-plugins/pull/2207
Author: @JohnJyong
Created: 12/8/2025
Status: Merged
Merged: 12/9/2025
Merged by: @JohnJyong

Base: mainHead: feat/support-jina-v4


📝 Commits (9)

  • de82904 support multimodal embedding and reranking
  • 5e1e406 support multimodal embedding and reranking
  • bdc2ff2 Merge branch 'main' into feat/support-jina-v4
  • 6f37f6a support multimodal embedding and reranking
  • 46becb9 support multimodal embedding and reranking
  • d68409a support multimodal embedding and reranking
  • afe7ee6 Merge branch 'main' into feat/support-jina-v4
  • 8c8bd76 fix dify-extractor
  • 82939cf update dify-plugin

📊 Changes

23 files changed (+599 additions, -65 deletions)

View changed files

📝 models/bedrock/manifest.yaml (+1 -1)
📝 models/bedrock/models/text_embedding/amazon.nova-2-multimodal-embeddings-v1.yaml (+2 -0)
📝 models/bedrock/models/text_embedding/text_embedding.py (+109 -3)
📝 models/bedrock/requirements.txt (+1 -1)
📝 models/jina/manifest.yaml (+1 -1)
📝 models/jina/models/rerank/jina-reranker-m0.yaml (+3 -1)
📝 models/jina/models/rerank/rerank.py (+74 -1)
📝 models/jina/models/shared/input.py (+28 -1)
📝 models/jina/models/text_embedding/jina-clip-v1.yaml (+2 -0)
📝 models/jina/models/text_embedding/jina-clip-v2.yaml (+2 -0)
📝 models/jina/models/text_embedding/jina-embeddings-v4.yaml (+2 -0)
📝 models/jina/models/text_embedding/text_embedding.py (+89 -1)
📝 models/jina/requirements.txt (+2 -2)
📝 models/tongyi/manifest.yaml (+1 -1)
models/tongyi/models/text_embedding/multimodal-embedding-v1.yaml (+12 -0)
📝 models/tongyi/models/text_embedding/text_embedding.py (+99 -1)
📝 models/tongyi/requirements.txt (+2 -2)
📝 models/vertex_ai/manifest.yaml (+1 -1)
models/vertex_ai/models/text_embedding/multimodalembedding-001.yaml (+10 -0)
📝 models/vertex_ai/models/text_embedding/text_embedding.py (+151 -45)

...and 3 more files

📄 Description

Related Issues or Context

This PR contains Changes to Non-Plugin

  • Documentation
  • Other

This PR contains Changes to Non-LLM Models Plugin

  • I have Run Comprehensive Tests Relevant to My Changes

This PR contains Changes to LLM Models Plugin

  • My Changes Affect Message Flow Handling (System Messages and User→Assistant Turn-Taking)
  • My Changes Affect Tool Interaction Flow (Multi-Round Usage and Output Handling, for both Agent App and Agent Node)
  • My Changes Affect Multimodal Input Handling (Images, PDFs, Audio, Video, etc.)
  • My Changes Affect Multimodal Output Generation (Images, Audio, Video, etc.)
  • My Changes Affect Structured Output Format (JSON, XML, etc.)
  • My Changes Affect Token Consumption Metrics
  • My Changes Affect Other LLM Functionalities (Reasoning Process, Grounding, Prompt Caching, etc.)
  • Other Changes (Add New Models, Fix Model Parameters etc.)

Version Control (Any Changes to the Plugin Will Require Bumping the Version)

  • I have Bumped Up the Version in Manifest.yaml (Top-Level Version Field, Not in Meta Section)

Dify Plugin SDK Version

  • I have Ensured dify_plugin>=0.3.0,<0.6.0 is in requirements.txt (SDK docs)

Environment Verification (If Any Code Changes)

Local Deployment Environment

  • Dify Version is: , I have Tested My Changes on Local Deployment Dify with a Clean Environment That Matches the Production Configuration.

SaaS Environment

  • I have Tested My Changes on cloud.dify.ai with a Clean Environment That Matches the Production Configuration

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/langgenius/dify-official-plugins/pull/2207 **Author:** [@JohnJyong](https://github.com/JohnJyong) **Created:** 12/8/2025 **Status:** ✅ Merged **Merged:** 12/9/2025 **Merged by:** [@JohnJyong](https://github.com/JohnJyong) **Base:** `main` ← **Head:** `feat/support-jina-v4` --- ### 📝 Commits (9) - [`de82904`](https://github.com/langgenius/dify-official-plugins/commit/de829049f2adb47da481b035d4ae7b4657839ea6) support multimodal embedding and reranking - [`5e1e406`](https://github.com/langgenius/dify-official-plugins/commit/5e1e406f5903f8816662644e302cd0d2b0e60b7d) support multimodal embedding and reranking - [`bdc2ff2`](https://github.com/langgenius/dify-official-plugins/commit/bdc2ff227e342462dde099152093e213f2360f25) Merge branch 'main' into feat/support-jina-v4 - [`6f37f6a`](https://github.com/langgenius/dify-official-plugins/commit/6f37f6ac3a07b31cc9a8a790b5870ec7ec199890) support multimodal embedding and reranking - [`46becb9`](https://github.com/langgenius/dify-official-plugins/commit/46becb9ff3981d37c61497c4ddce832bc8c16bc5) support multimodal embedding and reranking - [`d68409a`](https://github.com/langgenius/dify-official-plugins/commit/d68409ab861f8870642bf6c06f07677a321c10a5) support multimodal embedding and reranking - [`afe7ee6`](https://github.com/langgenius/dify-official-plugins/commit/afe7ee6a0984df714a2e909299d0a6f2a4a9ea69) Merge branch 'main' into feat/support-jina-v4 - [`8c8bd76`](https://github.com/langgenius/dify-official-plugins/commit/8c8bd764407d72bd6fd9fa93958d1ce5b4d34f27) fix dify-extractor - [`82939cf`](https://github.com/langgenius/dify-official-plugins/commit/82939cf83ee7d2865656d88854f3d8c0fbab408d) update dify-plugin ### 📊 Changes **23 files changed** (+599 additions, -65 deletions) <details> <summary>View changed files</summary> 📝 `models/bedrock/manifest.yaml` (+1 -1) 📝 `models/bedrock/models/text_embedding/amazon.nova-2-multimodal-embeddings-v1.yaml` (+2 -0) 📝 `models/bedrock/models/text_embedding/text_embedding.py` (+109 -3) 📝 `models/bedrock/requirements.txt` (+1 -1) 📝 `models/jina/manifest.yaml` (+1 -1) 📝 `models/jina/models/rerank/jina-reranker-m0.yaml` (+3 -1) 📝 `models/jina/models/rerank/rerank.py` (+74 -1) 📝 `models/jina/models/shared/input.py` (+28 -1) 📝 `models/jina/models/text_embedding/jina-clip-v1.yaml` (+2 -0) 📝 `models/jina/models/text_embedding/jina-clip-v2.yaml` (+2 -0) 📝 `models/jina/models/text_embedding/jina-embeddings-v4.yaml` (+2 -0) 📝 `models/jina/models/text_embedding/text_embedding.py` (+89 -1) 📝 `models/jina/requirements.txt` (+2 -2) 📝 `models/tongyi/manifest.yaml` (+1 -1) ➕ `models/tongyi/models/text_embedding/multimodal-embedding-v1.yaml` (+12 -0) 📝 `models/tongyi/models/text_embedding/text_embedding.py` (+99 -1) 📝 `models/tongyi/requirements.txt` (+2 -2) 📝 `models/vertex_ai/manifest.yaml` (+1 -1) ➕ `models/vertex_ai/models/text_embedding/multimodalembedding-001.yaml` (+10 -0) 📝 `models/vertex_ai/models/text_embedding/text_embedding.py` (+151 -45) _...and 3 more files_ </details> ### 📄 Description ## Related Issues or Context <!-- ⚠️ NOTE: This repository is for Dify Official Plugins only. For community contributions, please submit to https://github.com/langgenius/dify-plugins instead. - Link Related Issues if Applicable: #issue_number - Or Provide Context about Why this Change is Needed --> ## This PR contains Changes to *Non-Plugin* <!-- Put an `x` in all the boxes that apply by replacing [ ] with [x] For example: - [x] Documentation --> - [ ] Documentation - [x] Other ## This PR contains Changes to *Non-LLM Models Plugin* - [x] I have Run Comprehensive Tests Relevant to My Changes <!-- 📷 Include Screenshots/Videos Demonstrating the Fix, New Feature, or the Behavior Before/After Breaking Changes. --> ## This PR contains Changes to *LLM Models Plugin* <!-- LLM Models Test Example: --> <!-- https://github.com/langgenius/dify-official-plugins/blob/main/.assets/test-examples/llm-plugin-tests/llm_test_example.md --> - [ ] My Changes Affect Message Flow Handling (System Messages and User→Assistant Turn-Taking) <!-- 📷 Include Screenshots/Videos Demonstrating the Fix, New Feature, or the Behavior Before/After Breaking Changes. --> - [ ] My Changes Affect Tool Interaction Flow (Multi-Round Usage and Output Handling, for both Agent App and Agent Node) <!-- 📷 Include Screenshots/Videos Demonstrating the Fix, New Feature, or the Behavior Before/After Breaking Changes. --> - [ ] My Changes Affect Multimodal Input Handling (Images, PDFs, Audio, Video, etc.) <!-- 📷 Include Screenshots/Videos Demonstrating the Fix, New Feature, or the Behavior Before/After Breaking Changes. --> - [ ] My Changes Affect Multimodal Output Generation (Images, Audio, Video, etc.) <!-- 📷 Include Screenshots/Videos Demonstrating the Fix, New Feature, or the Behavior Before/After Breaking Changes. --> - [ ] My Changes Affect Structured Output Format (JSON, XML, etc.) <!-- 📷 Include Screenshots/Videos Demonstrating the Fix, New Feature, or the Behavior Before/After Breaking Changes. --> - [ ] My Changes Affect Token Consumption Metrics <!-- 📷 Include Screenshots/Videos Demonstrating the Fix, New Feature, or the Behavior Before/After Breaking Changes. --> - [ ] My Changes Affect Other LLM Functionalities (Reasoning Process, Grounding, Prompt Caching, etc.) <!-- 📷 Include Screenshots/Videos Demonstrating the Fix, New Feature, or the Behavior Before/After Breaking Changes. --> - [ ] Other Changes (Add New Models, Fix Model Parameters etc.) <!-- 📷 Include Screenshots/Videos Demonstrating the Fix, New Feature, or the Behavior Before/After Breaking Changes. --> ## Version Control (Any Changes to the Plugin Will Require Bumping the Version) - [ ] I have Bumped Up the Version in Manifest.yaml (Top-Level `Version` Field, Not in Meta Section) <!-- ⚠️ NOTE: Version Format: MAJOR.MINOR.PATCH - MAJOR (0.x.x): Reserved for Significant architectural changes or incompatible API modifications - MINOR (x.0.x): For New feature additions while maintaining backward compatibility - PATCH (x.x.0): For Backward-compatible bug fixes and minor improvements - Note: Each Version Component (MAJOR, MINOR, PATCH) Can Be 2 Digits, e.g., 10.11.22 --> ## Dify Plugin SDK Version - [ ] I have Ensured `dify_plugin>=0.3.0,<0.6.0` is in requirements.txt ([SDK docs](https://github.com/langgenius/dify-plugin-sdks/blob/main/python/README.md)) ## Environment Verification (If Any Code Changes) <!-- ⚠️ NOTE: At Least One Environment Must Be Tested. --> ### Local Deployment Environment - [ ] Dify Version is: <!-- Specify Your Version (e.g., 1.2.0) -->, I have Tested My Changes on Local Deployment Dify with a Clean Environment That Matches the Production Configuration. <!-- - Python Virtual Env Matching Manifest.yaml & requirements.txt - No Breaking Changes in Dify That May Affect the Testing Result --> ### SaaS Environment - [ ] I have Tested My Changes on cloud.dify.ai with a Clean Environment That Matches the Production Configuration <!-- - Python Virtual Env Matching Manifest.yaml & requirements.txt --> --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-16 11:16:41 -05:00
yindo closed this issue 2026-02-16 11:16:41 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify-official-plugins#2323