langgenius/dify-plugin-daemon
1
0
Fork 0
mirror of https://github.com/langgenius/dify-plugin-daemon.git synced 2026-07-21 09:15:24 -04:00
Code Issues 111 Packages Projects Releases 10 Wiki Activity

[PR #503] [MERGED] feat: support multimodal rerank and embedding #544

New Issue
Closed
opened 2026-02-16 01:16:17 -05:00 by yindo · 0 comments
yindo commented 2026-02-16 01:16:17 -05:00
Owner
Copy Link
Copy Source

📋 Pull Request Information

Original PR: https://github.com/langgenius/dify-plugin-daemon/pull/503
Author: @Yeuoly
Created: 11/14/2025
Status: ✅ Merged
Merged: 12/9/2025
Merged by: @Yeuoly

Base: main ← Head: codex/add-multimodal-rerank-and-embedding-apis

📝 Commits (5)

  • 08750db fix: align multimodal permission mapping
  • 0aeb735 fix: implement mock interface for multimodal embeddings
  • fc3ed53 fix: support multimodal embedding
  • f957635 Merge branch 'main' into codex/add-multimodal-rerank-and-embedding-apis
  • 6d0a3a5 fix: incorrect reference

📊 Changes

16 files changed (+308 additions, -16 deletions)

View changed files

📝 internal/core/dify_invocation/calldify/http_request.go (+8 -0)
📝 internal/core/dify_invocation/invcation.go (+4 -0)
📝 internal/core/dify_invocation/mock/mock.go (+25 -0)
📝 internal/core/dify_invocation/types.go (+14 -0)
📝 internal/core/io_tunnel/access_types/access.go (+2 -0)
📝 internal/core/io_tunnel/backwards_invocation/task.go (+47 -1)
📝 internal/core/io_tunnel/model.gen.go (+26 -0)
📝 internal/core/testutils/runtime.go (+2 -1)
📝 internal/server/controllers/definitions/definitions.go (+22 -0)
📝 internal/server/controllers/model.gen.go (+26 -0)
📝 internal/server/http_server.gen.go (+2 -0)
📝 internal/service/model.gen.go (+34 -0)
📝 pkg/entities/model_entities/llm.go (+8 -6)
➕ pkg/entities/model_entities/multimodal.go (+48 -0)
📝 pkg/entities/plugin_entities/model_declaration.go (+12 -8)
📝 pkg/entities/requests/model.go (+28 -0)

📄 Description

Summary

  • remove the dedicated multimodal model type and custom validator so requests accept arbitrary provider identifiers
  • keep multimodal rerank and embedding request payloads requiring a model_type string without restricting it to the vendor value
  • map the multimodal embedding and rerank invoke types directly to the existing text-embedding and rerank permission checks

Testing

  • go test ./... (fails: requires PRIVATE_KEY.pem)

Codex Task

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/langgenius/dify-plugin-daemon/pull/503 **Author:** [@Yeuoly](https://github.com/Yeuoly) **Created:** 11/14/2025 **Status:** ✅ Merged **Merged:** 12/9/2025 **Merged by:** [@Yeuoly](https://github.com/Yeuoly) **Base:** `main` ← **Head:** `codex/add-multimodal-rerank-and-embedding-apis` --- ### 📝 Commits (5) - [`08750db`](https://github.com/langgenius/dify-plugin-daemon/commit/08750db7061a782da30277e6c0cb6e382765e405) fix: align multimodal permission mapping - [`0aeb735`](https://github.com/langgenius/dify-plugin-daemon/commit/0aeb735c6652552bc4266ebfad3cb4fe8a567e23) fix: implement mock interface for multimodal embeddings - [`fc3ed53`](https://github.com/langgenius/dify-plugin-daemon/commit/fc3ed530271aa6d7098a85b5921dce66fce5d0aa) fix: support multimodal embedding - [`f957635`](https://github.com/langgenius/dify-plugin-daemon/commit/f957635f4e66be2e09c19c817bf5bf05b7e8e8c4) Merge branch 'main' into codex/add-multimodal-rerank-and-embedding-apis - [`6d0a3a5`](https://github.com/langgenius/dify-plugin-daemon/commit/6d0a3a50dca3bc9e678dc622be449884a39bf1af) fix: incorrect reference ### 📊 Changes **16 files changed** (+308 additions, -16 deletions) <details> <summary>View changed files</summary> 📝 `internal/core/dify_invocation/calldify/http_request.go` (+8 -0) 📝 `internal/core/dify_invocation/invcation.go` (+4 -0) 📝 `internal/core/dify_invocation/mock/mock.go` (+25 -0) 📝 `internal/core/dify_invocation/types.go` (+14 -0) 📝 `internal/core/io_tunnel/access_types/access.go` (+2 -0) 📝 `internal/core/io_tunnel/backwards_invocation/task.go` (+47 -1) 📝 `internal/core/io_tunnel/model.gen.go` (+26 -0) 📝 `internal/core/testutils/runtime.go` (+2 -1) 📝 `internal/server/controllers/definitions/definitions.go` (+22 -0) 📝 `internal/server/controllers/model.gen.go` (+26 -0) 📝 `internal/server/http_server.gen.go` (+2 -0) 📝 `internal/service/model.gen.go` (+34 -0) 📝 `pkg/entities/model_entities/llm.go` (+8 -6) ➕ `pkg/entities/model_entities/multimodal.go` (+48 -0) 📝 `pkg/entities/plugin_entities/model_declaration.go` (+12 -8) 📝 `pkg/entities/requests/model.go` (+28 -0) </details> ### 📄 Description ## Summary - remove the dedicated multimodal model type and custom validator so requests accept arbitrary provider identifiers - keep multimodal rerank and embedding request payloads requiring a model_type string without restricting it to the vendor value - map the multimodal embedding and rerank invoke types directly to the existing text-embedding and rerank permission checks ## Testing - go test ./... *(fails: requires PRIVATE_KEY.pem)* ------ [Codex Task](https://chatgpt.com/codex/tasks/task_b_69144ef477148326808e2a6c72a88672) --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-16 01:16:17 -05:00
yindo closed this issue 2026-02-16 01:16:17 -05:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Windows
bug
cmd
documentation
enhancement
go
good first issue
plugin-daemon
pull-request
Mirrored from GitHub Pull Request
 question
No Label pull-request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify-plugin-daemon#544
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?