[PR #1649] [MERGED] feat: introduce datasource plugins and chunker plugins for RAG pipeline #2010

Closed
opened 2026-02-16 11:15:51 -05:00 by yindo · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/langgenius/dify-official-plugins/pull/1649
Author: @QuantumGhost
Created: 9/4/2025
Status: Merged
Merged: 9/4/2025
Merged by: @QuantumGhost

Base: mainHead: feat/datasource-merge


📝 Commits (5)

  • 4c3d2dc feat: Introduce datasource plugins
  • 236aa18 feat: Introduce chunkers for RAG pipelines
  • c9f3cfe feat: Introduce dify_extractor tool
  • ae47042 fix: README title (#1648)
  • afa2d10 add readme and privacy

📊 Changes

304 files changed (+27228 additions, -0 deletions)

View changed files

datasources/aws_s3_storage/.difyignore (+179 -0)
datasources/aws_s3_storage/PRIVACY.md (+47 -0)
datasources/aws_s3_storage/README.md (+149 -0)
datasources/aws_s3_storage/_assets/icon.svg (+20 -0)
datasources/aws_s3_storage/datasources/aws_s3_storage.py (+82 -0)
datasources/aws_s3_storage/datasources/aws_s3_storage.yaml (+20 -0)
datasources/aws_s3_storage/main.py (+6 -0)
datasources/aws_s3_storage/manifest.yaml (+30 -0)
datasources/aws_s3_storage/provider/aws_s3_storage.py (+35 -0)
datasources/aws_s3_storage/provider/aws_s3_storage.yaml (+51 -0)
datasources/aws_s3_storage/requirements.txt (+2 -0)
datasources/azure_blob/.difyignore (+69 -0)
datasources/azure_blob/PRIVACY.md (+158 -0)
datasources/azure_blob/README.md (+67 -0)
datasources/azure_blob/_assets/icon.svg (+20 -0)
datasources/azure_blob/datasources/azure_blob.py (+538 -0)
datasources/azure_blob/datasources/azure_blob.yaml (+28 -0)
datasources/azure_blob/main.py (+7 -0)
datasources/azure_blob/manifest.yaml (+39 -0)
datasources/azure_blob/provider/azure_blob.py (+453 -0)

...and 80 more files

📄 Description

Related Issues or Context

This PR contains Changes to Non-Plugin

  • Documentation
  • Other

This PR contains Changes to Non-LLM Models Plugin

  • I have Run Comprehensive Tests Relevant to My Changes

Version Control (Any Changes to the Plugin Will Require Bumping the Version)

  • I have Bumped Up the Version in Manifest.yaml (Top-Level Version Field, Not in Meta Section)

Dify Plugin SDK Version

  • I have Ensured dify_plugin>=0.3.0,<0.5.0 is in requirements.txt (SDK docs)

Environment Verification (If Any Code Changes)

Local Deployment Environment

  • Dify Version is: , I have Tested My Changes on Local Deployment Dify with a Clean Environment That Matches the Production Configuration.

SaaS Environment

  • I have Tested My Changes on cloud.dify.ai with a Clean Environment That Matches the Production Configuration

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/langgenius/dify-official-plugins/pull/1649 **Author:** [@QuantumGhost](https://github.com/QuantumGhost) **Created:** 9/4/2025 **Status:** ✅ Merged **Merged:** 9/4/2025 **Merged by:** [@QuantumGhost](https://github.com/QuantumGhost) **Base:** `main` ← **Head:** `feat/datasource-merge` --- ### 📝 Commits (5) - [`4c3d2dc`](https://github.com/langgenius/dify-official-plugins/commit/4c3d2dcd8665d925edbe5f592ac1de8690b3e8da) feat: Introduce datasource plugins - [`236aa18`](https://github.com/langgenius/dify-official-plugins/commit/236aa185a6967f5d2e062d35da8e2713b2b0cbef) feat: Introduce chunkers for RAG pipelines - [`c9f3cfe`](https://github.com/langgenius/dify-official-plugins/commit/c9f3cfed5d77c30ff5109f81baedf16dc37e261b) feat: Introduce dify_extractor tool - [`ae47042`](https://github.com/langgenius/dify-official-plugins/commit/ae4704251d05d1201130e32a13056eb85ecb45f7) fix: README title (#1648) - [`afa2d10`](https://github.com/langgenius/dify-official-plugins/commit/afa2d10987a73627fd340001da5c3bf162b3efe0) add readme and privacy ### 📊 Changes **304 files changed** (+27228 additions, -0 deletions) <details> <summary>View changed files</summary> ➕ `datasources/aws_s3_storage/.difyignore` (+179 -0) ➕ `datasources/aws_s3_storage/PRIVACY.md` (+47 -0) ➕ `datasources/aws_s3_storage/README.md` (+149 -0) ➕ `datasources/aws_s3_storage/_assets/icon.svg` (+20 -0) ➕ `datasources/aws_s3_storage/datasources/aws_s3_storage.py` (+82 -0) ➕ `datasources/aws_s3_storage/datasources/aws_s3_storage.yaml` (+20 -0) ➕ `datasources/aws_s3_storage/main.py` (+6 -0) ➕ `datasources/aws_s3_storage/manifest.yaml` (+30 -0) ➕ `datasources/aws_s3_storage/provider/aws_s3_storage.py` (+35 -0) ➕ `datasources/aws_s3_storage/provider/aws_s3_storage.yaml` (+51 -0) ➕ `datasources/aws_s3_storage/requirements.txt` (+2 -0) ➕ `datasources/azure_blob/.difyignore` (+69 -0) ➕ `datasources/azure_blob/PRIVACY.md` (+158 -0) ➕ `datasources/azure_blob/README.md` (+67 -0) ➕ `datasources/azure_blob/_assets/icon.svg` (+20 -0) ➕ `datasources/azure_blob/datasources/azure_blob.py` (+538 -0) ➕ `datasources/azure_blob/datasources/azure_blob.yaml` (+28 -0) ➕ `datasources/azure_blob/main.py` (+7 -0) ➕ `datasources/azure_blob/manifest.yaml` (+39 -0) ➕ `datasources/azure_blob/provider/azure_blob.py` (+453 -0) _...and 80 more files_ </details> ### 📄 Description ## Related Issues or Context ## This PR contains Changes to *Non-Plugin* - [ ] Documentation - [ ] Other ## This PR contains Changes to *Non-LLM Models Plugin* - [x] I have Run Comprehensive Tests Relevant to My Changes ## Version Control (Any Changes to the Plugin Will Require Bumping the Version) - [ ] I have Bumped Up the Version in Manifest.yaml (Top-Level `Version` Field, Not in Meta Section) ## Dify Plugin SDK Version - [ ] I have Ensured `dify_plugin>=0.3.0,<0.5.0` is in requirements.txt ([SDK docs](https://github.com/langgenius/dify-plugin-sdks/blob/main/python/README.md)) ## Environment Verification (If Any Code Changes) ### Local Deployment Environment - [ ] Dify Version is: <!-- Specify Your Version (e.g., 1.2.0) -->, I have Tested My Changes on Local Deployment Dify with a Clean Environment That Matches the Production Configuration. ### SaaS Environment - [ ] I have Tested My Changes on cloud.dify.ai with a Clean Environment That Matches the Production Configuration --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-16 11:15:51 -05:00
yindo closed this issue 2026-02-16 11:15:51 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify-official-plugins#2010