Support for text-embeddings-inference #4165

Closed
opened 2026-02-21 18:05:02 -05:00 by yindo · 0 comments
Owner

Originally created by @paulcx on GitHub (Jun 19, 2024).

Self Checks

  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing?

I was trying to use https://github.com/huggingface/text-embeddings-inference for hosting rerank model. Does current version support it? If it does, how to config the endpoint?

2. Describe the feature you'd like to see

Add support for text-embeddings-inference endpoint

3. How will this feature improve your workflow or experience?

It will support multiple m,odels like https://github.com/huggingface/text-embeddings-inference?tab=readme-ov-file#text-embeddings and https://github.com/huggingface/text-embeddings-inference?tab=readme-ov-file#sequence-classification-and-re-ranking

4. Additional context or comments

No response

5. Can you help us with this feature?

  • I am interested in contributing to this feature.
Originally created by @paulcx on GitHub (Jun 19, 2024). ### Self Checks - [X] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [X] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [X] Please do not modify this template :) and fill in all the required fields. ### 1. Is this request related to a challenge you're experiencing? I was trying to use https://github.com/huggingface/text-embeddings-inference for hosting rerank model. Does current version support it? If it does, how to config the endpoint? ### 2. Describe the feature you'd like to see Add support for text-embeddings-inference endpoint ### 3. How will this feature improve your workflow or experience? It will support multiple m,odels like https://github.com/huggingface/text-embeddings-inference?tab=readme-ov-file#text-embeddings and https://github.com/huggingface/text-embeddings-inference?tab=readme-ov-file#sequence-classification-and-re-ranking ### 4. Additional context or comments _No response_ ### 5. Can you help us with this feature? - [ ] I am interested in contributing to this feature.
yindo added the 💪 enhancement label 2026-02-21 18:05:02 -05:00
yindo closed this issue 2026-02-21 18:05:02 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#4165