[Feature request] #20762

Closed
opened 2026-02-21 20:08:51 -05:00 by yindo · 1 comment
Owner

Originally created by @Reedccc on GitHub (Dec 3, 2025).

Self Checks

  • I have read the Contributing Guide and Language Policy.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report, otherwise it will be closed.
  • Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

I need to add a rerank model through vllm, but dify's vllm template only provide LLM type, there is no rerank type.

2. Additional context or comments

No response

3. Can you help us with this feature?

  • I am interested in contributing to this feature.
Originally created by @Reedccc on GitHub (Dec 3, 2025). ### Self Checks - [x] I have read the [Contributing Guide](https://github.com/langgenius/dify/blob/main/CONTRIBUTING.md) and [Language Policy](https://github.com/langgenius/dify/issues/1542). - [x] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [x] I confirm that I am using English to submit this report, otherwise it will be closed. - [x] Please do not modify this template :) and fill in all the required fields. ### 1. Is this request related to a challenge you're experiencing? Tell me about your story. I need to add a rerank model through vllm, but dify's vllm template only provide LLM type, there is no rerank type. ### 2. Additional context or comments _No response_ ### 3. Can you help us with this feature? - [ ] I am interested in contributing to this feature.
yindo added the 💪 enhancement label 2026-02-21 20:08:51 -05:00
yindo closed this issue 2026-02-21 20:08:51 -05:00
Author
Owner

@Reedccc commented on GitHub (Dec 3, 2025):

@crazywoola How to add a rerank model through vllm now =_=

@Reedccc commented on GitHub (Dec 3, 2025): @crazywoola How to add a rerank model through vllm now =_=
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#20762