The embedding model deployed locally using Vllm cannot be configured on the page #17667

Closed
opened 2026-02-21 19:38:11 -05:00 by yindo · 0 comments
Owner

Originally created by @mxyd on GitHub (Sep 18, 2025).

Self Checks

  • I have read the Contributing Guide and Language Policy.
  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report, otherwise it will be closed.
  • 【中文用户 & Non English User】请使用英语提交,否则会被关闭 :)
  • Please do not modify this template :) and fill in all the required fields.

Dify version

1.8.1

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

The embedding model deployed locally using Vllm cannot be configured on the page
本地使用Vllm 部署的embedding 模型,在页面无法配置

没有embedding 和 rerank 的选项

Image****

✔️ Expected Behavior

可以配置使用VLLM 部署的本地模型

Actual Behavior

No response

Originally created by @mxyd on GitHub (Sep 18, 2025). ### Self Checks - [x] I have read the [Contributing Guide](https://github.com/langgenius/dify/blob/main/CONTRIBUTING.md) and [Language Policy](https://github.com/langgenius/dify/issues/1542). - [x] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [x] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [x] I confirm that I am using English to submit this report, otherwise it will be closed. - [x] 【中文用户 & Non English User】请使用英语提交,否则会被关闭 :) - [x] Please do not modify this template :) and fill in all the required fields. ### Dify version 1.8.1 ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce The embedding model deployed locally using Vllm cannot be configured on the page 本地使用Vllm 部署的embedding 模型,在页面无法配置 没有embedding 和 rerank 的选项 <img width="644" height="695" alt="Image" src="https://github.com/user-attachments/assets/50312346-ea4f-4fda-bc16-5fb329fbacd0" />**** ### ✔️ Expected Behavior 可以配置使用VLLM 部署的本地模型 ### ❌ Actual Behavior _No response_
yindo closed this issue 2026-02-21 19:38:11 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#17667