Support Kserve LLM endpoint #6375

Closed
opened 2026-02-21 18:15:27 -05:00 by yindo · 1 comment
Owner

Originally created by @gxx-ljy on GitHub (Oct 28, 2024).

Self Checks

  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

Hope it can support llms deployed by kserve

2. Additional context or comments

https://kserve.github.io/website/latest/modelserving/v1beta1/llm/huggingface/text_generation/

3. Can you help us with this feature?

  • I am interested in contributing to this feature.
Originally created by @gxx-ljy on GitHub (Oct 28, 2024). ### Self Checks - [X] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [X] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [X] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:) - [X] Please do not modify this template :) and fill in all the required fields. ### 1. Is this request related to a challenge you're experiencing? Tell me about your story. Hope it can support llms deployed by kserve ### 2. Additional context or comments https://kserve.github.io/website/latest/modelserving/v1beta1/llm/huggingface/text_generation/ ### 3. Can you help us with this feature? - [ ] I am interested in contributing to this feature.
yindo added the 💪 enhancement label 2026-02-21 18:15:27 -05:00
yindo closed this issue 2026-02-21 18:15:27 -05:00
Author
Owner

@dosubot[bot] commented on GitHub (Nov 28, 2024):

Hi, @gxx-ljy. I'm Dosu, and I'm helping the Dify team manage their backlog. I'm marking this issue as stale.

Issue Summary:

  • Request for support of LLMs deployed via Kserve in Dify.
  • You provided a link to Kserve's documentation for context.
  • No further comments or activity since the issue was opened.

Next Steps:

  • Please confirm if this issue is still relevant to the latest version of Dify by commenting here.
  • If there is no further activity, the issue will be automatically closed in 15 days.

Thank you for your understanding and contribution!

@dosubot[bot] commented on GitHub (Nov 28, 2024): Hi, @gxx-ljy. I'm [Dosu](https://dosu.dev), and I'm helping the Dify team manage their backlog. I'm marking this issue as stale. **Issue Summary:** - Request for support of LLMs deployed via Kserve in Dify. - You provided a link to Kserve's documentation for context. - No further comments or activity since the issue was opened. **Next Steps:** - Please confirm if this issue is still relevant to the latest version of Dify by commenting here. - If there is no further activity, the issue will be automatically closed in 15 days. Thank you for your understanding and contribution!
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#6375