[Feature Request] Structuring Outputs using OpenAi-API-compatible #11026

Closed
opened 2026-02-21 18:54:00 -05:00 by yindo · 0 comments
Owner

Originally created by @SingCheng on GitHub (Mar 14, 2025).

Self Checks

  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

I am currently using VLLM to obtain responses from a language model. In some cases, I need the model to return responses in JSON format to ensure that all key information is preserved.

Without JSON formatting, critical details may be lost, which can impede further processing.

For instance, VLLM is capable of returning structured output.

2. Additional context or comments

OpenAi-API-compatible
Image

3. Can you help us with this feature?

  • I am interested in contributing to this feature.
Originally created by @SingCheng on GitHub (Mar 14, 2025). ### Self Checks - [x] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [x] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:) - [x] Please do not modify this template :) and fill in all the required fields. ### 1. Is this request related to a challenge you're experiencing? Tell me about your story. I am currently using VLLM to obtain responses from a language model. In some cases, I need the model to return responses in JSON format to ensure that all key information is preserved. Without JSON formatting, critical details may be lost, which can impede further processing. For instance, VLLM is capable of returning structured output. ### 2. Additional context or comments OpenAi-API-compatible ![Image](https://github.com/user-attachments/assets/5b7e12e8-b465-4c71-9e1a-471ad7126d80) ### 3. Can you help us with this feature? - [x] I am interested in contributing to this feature.
yindo added the 💪 enhancement label 2026-02-21 18:54:00 -05:00
yindo closed this issue 2026-02-21 18:54:00 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#11026