[PR #237] [MERGED] feat: support multimodal embeddings #248

Closed
opened 2026-02-15 21:16:25 -05:00 by yindo · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/langgenius/dify-plugin-sdks/pull/237
Author: @Yeuoly
Created: 11/14/2025
Status: Merged
Merged: 12/8/2025
Merged by: @Yeuoly

Base: mainHead: codex/add-multimodal-rerank-and-embedding-interfaces


📝 Commits (10+)

  • a933f42 Inline multimodal entities into existing models
  • 19ca6c5 apply ruff
  • 0b8e5f0 Merge branch 'main' into codex/add-multimodal-rerank-and-embedding-interfaces
  • 5250460 Merge branch 'main' into codex/add-multimodal-rerank-and-embedding-interfaces
  • 0bd99d4 bump to 0.7.0b1
  • 7d225d9 fix: remove tenant_id from invoke_multimodal_embedding
  • cd81d57 tests: add rerank
  • aea1032 apply ruff
  • 2d3a005 fix
  • 7118abe fix: typing

📊 Changes

13 files changed (+445 additions, -10 deletions)

View changed files

📝 python/dify_plugin/core/entities/invocation.py (+2 -0)
📝 python/dify_plugin/core/entities/plugin/request.py (+23 -2)
📝 python/dify_plugin/core/plugin_executor.py (+28 -0)
📝 python/dify_plugin/entities/model/rerank.py (+24 -1)
📝 python/dify_plugin/entities/model/text_embedding.py (+33 -1)
📝 python/dify_plugin/interfaces/model/rerank_model.py (+48 -1)
📝 python/dify_plugin/interfaces/model/text_embedding_model.py (+44 -1)
📝 python/dify_plugin/invocations/model/rerank.py (+28 -1)
📝 python/dify_plugin/invocations/model/text_embedding.py (+30 -1)
📝 python/dify_plugin/plugin.py (+12 -0)
📝 python/pyproject.toml (+1 -1)
python/tests/interfaces/model/test_rerank.py (+104 -0)
📝 python/tests/interfaces/model/test_text_embedding.py (+68 -1)

📄 Description

Summary

  • inline the multimodal content, config, and result models into the existing text embedding and rerank entity modules and drop the standalone multimodal module
  • refresh imports and error messaging for the reorganized multimodal hooks in the embedding and rerank model interfaces and executor plumbing
  • add a mock text embedding model unit test that exercises the multimodal invoke path

Testing

  • pytest python/tests/test_multimodal_requests.py

Codex Task


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/langgenius/dify-plugin-sdks/pull/237 **Author:** [@Yeuoly](https://github.com/Yeuoly) **Created:** 11/14/2025 **Status:** ✅ Merged **Merged:** 12/8/2025 **Merged by:** [@Yeuoly](https://github.com/Yeuoly) **Base:** `main` ← **Head:** `codex/add-multimodal-rerank-and-embedding-interfaces` --- ### 📝 Commits (10+) - [`a933f42`](https://github.com/langgenius/dify-plugin-sdks/commit/a933f425f109482287b7546577ebe7d79bf81433) Inline multimodal entities into existing models - [`19ca6c5`](https://github.com/langgenius/dify-plugin-sdks/commit/19ca6c5c1e27c018efcad919ce48fb03d7f7b8bd) apply ruff - [`0b8e5f0`](https://github.com/langgenius/dify-plugin-sdks/commit/0b8e5f079767a097e9a6f378ee001f22ea4dfdf3) Merge branch 'main' into codex/add-multimodal-rerank-and-embedding-interfaces - [`5250460`](https://github.com/langgenius/dify-plugin-sdks/commit/525046048c485e47f0828e6f79d117fc38ce240b) Merge branch 'main' into codex/add-multimodal-rerank-and-embedding-interfaces - [`0bd99d4`](https://github.com/langgenius/dify-plugin-sdks/commit/0bd99d41eb288d7777a8bf903234e6a8d032f4c2) bump to 0.7.0b1 - [`7d225d9`](https://github.com/langgenius/dify-plugin-sdks/commit/7d225d9fcdefcc3099e07529346562d8edfaae4b) fix: remove tenant_id from invoke_multimodal_embedding - [`cd81d57`](https://github.com/langgenius/dify-plugin-sdks/commit/cd81d57a86bc4336567f167cdf101295b7ae63a8) tests: add rerank - [`aea1032`](https://github.com/langgenius/dify-plugin-sdks/commit/aea1032e118499652b58b0b862e8f2fc204c75ad) apply ruff - [`2d3a005`](https://github.com/langgenius/dify-plugin-sdks/commit/2d3a005317ef6af16e2f439f7cfceafda71c6b7a) fix - [`7118abe`](https://github.com/langgenius/dify-plugin-sdks/commit/7118abe26b15e4308970448594295d8e1921d139) fix: typing ### 📊 Changes **13 files changed** (+445 additions, -10 deletions) <details> <summary>View changed files</summary> 📝 `python/dify_plugin/core/entities/invocation.py` (+2 -0) 📝 `python/dify_plugin/core/entities/plugin/request.py` (+23 -2) 📝 `python/dify_plugin/core/plugin_executor.py` (+28 -0) 📝 `python/dify_plugin/entities/model/rerank.py` (+24 -1) 📝 `python/dify_plugin/entities/model/text_embedding.py` (+33 -1) 📝 `python/dify_plugin/interfaces/model/rerank_model.py` (+48 -1) 📝 `python/dify_plugin/interfaces/model/text_embedding_model.py` (+44 -1) 📝 `python/dify_plugin/invocations/model/rerank.py` (+28 -1) 📝 `python/dify_plugin/invocations/model/text_embedding.py` (+30 -1) 📝 `python/dify_plugin/plugin.py` (+12 -0) 📝 `python/pyproject.toml` (+1 -1) ➕ `python/tests/interfaces/model/test_rerank.py` (+104 -0) 📝 `python/tests/interfaces/model/test_text_embedding.py` (+68 -1) </details> ### 📄 Description ## Summary - inline the multimodal content, config, and result models into the existing text embedding and rerank entity modules and drop the standalone multimodal module - refresh imports and error messaging for the reorganized multimodal hooks in the embedding and rerank model interfaces and executor plumbing - add a mock text embedding model unit test that exercises the multimodal invoke path ## Testing - `pytest python/tests/test_multimodal_requests.py` ------ [Codex Task](https://chatgpt.com/codex/tasks/task_b_69159ab997c88326b907cb71693cb3b2) --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-15 21:16:25 -05:00
yindo closed this issue 2026-02-15 21:16:25 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify-plugin-sdks#248