[PR #83] [MERGED] vllm provider for guided generation #592

New Issue

2026-02-22T17:33:36-05:00

yindo commented

2026-02-22 17:33:36 -05:00

📋 Pull Request Information

Original PR: https://github.com/langgenius/dify-plugins/pull/83
Author: @yangyaofei
Created: 3/5/2025
Status: ✅ Merged
Merged: 3/19/2025
Merged by: @LogicOber

Base: main ← Head: main

📝 Commits (4)

da1350a vllm provider for guided generation
48318d2 update author
cc25cc1 Merge branch 'langgenius:main' into main
2f88b25 add PRIVACY.md, update readme.md, remove unnecessary file

📊 Changes

1 file changed (+0 additions, -0 deletions)

View changed files

➕ yangyaofei/dify-vllm-provider.difypkg (+0 -0)

📄 Description

Plugin Submission Form

1. Submission Type

New plugin submission
Version update for existing plugin

2. Description

vllm-openai dify provider plugin to support guided generate.

The vllm openAI compatible server
can make CFG(Classifier-Free Guidance) with outlines or
lm-format-enforcer with Extra Parameters like guided_json, guided_regex.
The openai compatible provider in Dify can not do this, but like gpt-4o can do same thing with json flag.

This plugin provide a vllm-openai provider upon Dify's openai compatible provider with guided_json, guided_regex, guided_grammar.

3. Checklist

I have read and followed the Publish to Dify Marketplace guidelines
I have read and comply with the Plugin Developer Agreement
I confirm my plugin works properly on both Dify Community Edition and Cloud Version
I confirm my plugin has been thoroughly tested for completeness and functionality
My plugin brings new value to Dify

4. Documentation Checklist

Please confirm that your plugin README includes all necessary information:

Step-by-step setup instructions
Detailed usage instructions
All required APIs and credentials are clearly listed
Connection requirements and configuration details

5. Privacy Protection Information

Based on Dify Plugin Privacy Protection Guidelines:

Data Collection

No data collection

Privacy Policy

I confirm that I have prepared and included a privacy policy in my plugin package based on the Plugin Privacy Protection Guidelines

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/langgenius/dify-plugins/pull/83 **Author:** [@yangyaofei](https://github.com/yangyaofei) **Created:** 3/5/2025 **Status:** ✅ Merged **Merged:** 3/19/2025 **Merged by:** [@LogicOber](https://github.com/LogicOber) **Base:** `main` ← **Head:** `main` --- ### 📝 Commits (4) - [`da1350a`](https://github.com/langgenius/dify-plugins/commit/da1350aebb8551a8dbe2a97b4fa70c7452373d94) vllm provider for guided generation - [`48318d2`](https://github.com/langgenius/dify-plugins/commit/48318d2b5966c1ee67a40294548bea3ba16952ed) update author - [`cc25cc1`](https://github.com/langgenius/dify-plugins/commit/cc25cc135dd988f7f79ce638a04ca4b8b1000c04) Merge branch 'langgenius:main' into main - [`2f88b25`](https://github.com/langgenius/dify-plugins/commit/2f88b256979cfb9bbe525cbae845191bc79f9d22) add PRIVACY.md, update readme.md, remove unnecessary file ### 📊 Changes **1 file changed** (+0 additions, -0 deletions) <details> <summary>View changed files</summary> ➕ `yangyaofei/dify-vllm-provider.difypkg` (+0 -0) </details> ### 📄 Description # Plugin Submission Form ## 1. Submission Type - [x] New plugin submission - [ ] Version update for existing plugin ## 2. Description vllm-openai dify provider plugin to support guided generate. The vllm [openAI compatible server](https://docs.vllm.ai/en/latest/serving/openai_compatible_server.html) can make CFG(Classifier-Free Guidance) with [outlines](https://github.com/dottxt-ai/outlines) or [lm-format-enforcer](https://github.com/noamgat/lm-format-enforcer) with `Extra Parameters` like `guided_json`, `guided_regex`. The openai compatible provider in Dify can not do this, but like gpt-4o can do same thing with json flag. This plugin provide a vllm-openai provider upon Dify's openai compatible provider with `guided_json`, `guided_regex`, `guided_grammar`. ## 3. Checklist - [x] I have read and followed the Publish to Dify Marketplace guidelines - [x] I have read and comply with the Plugin Developer Agreement - [x] I confirm my plugin works properly on both Dify Community Edition and Cloud Version - [x] I confirm my plugin has been thoroughly tested for completeness and functionality - [x] My plugin brings new value to Dify ## 4. Documentation Checklist Please confirm that your plugin README includes all necessary information: - [x] Step-by-step setup instructions - [x] Detailed usage instructions - [x] All required APIs and credentials are clearly listed - [x] Connection requirements and configuration details ## 5. Privacy Protection Information Based on Dify Plugin Privacy Protection [Guidelines](https://docs.dify.ai/plugins/publish-plugins/publish-to-dify-marketplace/plugin-privacy-protection-guidelines): ### Data Collection No data collection ### Privacy Policy - [x] I confirm that I have prepared and included a privacy policy in my plugin package based on the Plugin Privacy Protection Guidelines --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

yindo added the pull-request label 2026-02-22 17:33:36 -05:00

yindo closed this issue

2026-02-22 17:33:38 -05:00

yindo referenced this issue

2026-02-22 17:46:12 -05:00

[PR #592] [MERGED] New Plugin: Semantic Scholar – Search Academic Papers #1054

Sign in to join this conversation.

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: langgenius/dify-plugins#592