Integration with langserve #2680

Closed
opened 2026-02-21 17:48:44 -05:00 by yindo · 0 comments
Owner

Originally created by @yairyairyair on GitHub (Apr 26, 2024).

Self Checks

  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • Pleas do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing?

yes, i want to achieve high-availability for deploying dify LLM apps

2. Describe the feature you'd like to see

i want to deploy a dify LLM app via its own container with a langserve server.
we can do it and it will allow deploying a dify app SEPARATELY from dify itself, hence achieving better availability.
we can have an endpoint for a deployed dify app and it wont affect the compute load of dify platform itself.
this will make dify LLM Apps more reliably deployed.

3. How will this feature improve your workflow or experience?

better deployments both cloud and self-hosted

4. Additional context or comments

No response

5. Can you help us with this feature?

  • I am interested in contributing to this feature.
Originally created by @yairyairyair on GitHub (Apr 26, 2024). ### Self Checks - [X] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [X] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [X] Pleas do not modify this template :) and fill in all the required fields. ### 1. Is this request related to a challenge you're experiencing? yes, i want to achieve high-availability for deploying dify LLM apps ### 2. Describe the feature you'd like to see i want to deploy a dify LLM app via its own container with a langserve server. we can do it and it will allow deploying a dify app *SEPARATELY* from dify itself, hence achieving better availability. we can have an endpoint for a deployed dify app and it wont affect the compute load of dify platform itself. this will make dify LLM Apps more reliably deployed. ### 3. How will this feature improve your workflow or experience? better deployments both cloud and self-hosted ### 4. Additional context or comments _No response_ ### 5. Can you help us with this feature? - [ ] I am interested in contributing to this feature.
yindo added the 💪 enhancement label 2026-02-21 17:48:44 -05:00
yindo closed this issue 2026-02-21 17:48:44 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#2680