langgenius/dify-plugins
1
0
Fork 0
mirror of https://github.com/langgenius/dify-plugins.git synced 2026-07-22 01:55:36 -04:00
Code Issues 119 Packages Projects Releases Wiki Activity

[PR #1302] [MERGED] add WaterCrawl datasource plugin #1518

New Issue
Closed
opened 2026-02-22 18:00:25 -05:00 by yindo · 0 comments
yindo commented 2026-02-22 18:00:25 -05:00
Owner
Copy Link
Copy Source

📋 Pull Request Information

Original PR: https://github.com/langgenius/dify-plugins/pull/1302
Author: @amirasaran
Created: 9/28/2025
Status: ✅ Merged
Merged: 10/5/2025
Merged by: @crazywoola

Base: main ← Head: main

📝 Commits (1)

  • 5155f03 add WaterCrawl datasource plugin

📊 Changes

1 file changed (+0 additions, -0 deletions)

View changed files

➕ watercrawl/watercrawl_datasource/watercrawl-datasource-dify-plugin-v0.1.0.difypkg (+0 -0)

📄 Description

1. Metadata

2. Submission Type

  • New plugin submission

3. Description

The Watercrawl Datasource Plugin integrates with Watercrawl API to provide powerful web crawling capabilities for Dify workflows. It enables users to:

  • Recursively crawl websites with configurable depth and page limits
  • Extract clean, LLM-ready content from web pages with smart filtering
  • Use URL pattern matching to include/exclude specific sections
  • Support both fast crawling mode and comprehensive content extraction
  • Work with both Watercrawl cloud service and self-hosted instances
  • Output structured data with titles, descriptions, and markdown-formatted content

This plugin is ideal for building knowledge bases, content analysis, documentation indexing, and competitor monitoring workflows.

4. Checklist

  • I have read and followed the Publish to Dify Marketplace guidelines
  • I have read and comply with the Plugin Developer Agreement
  • I confirm my plugin works properly on both Dify Community Edition and Cloud Version
  • I confirm my plugin has been thoroughly tested for completeness and functionality
  • My plugin brings new value to Dify

5. Documentation Checklist

Please confirm that your plugin README includes all necessary information:

  • Step-by-step setup instructions
  • Detailed usage instructions
  • All required APIs and credentials are clearly listed
  • Connection requirements and configuration details
  • Link to the repository for the plugin source code

6. Privacy Protection Information

Based on Dify Plugin Privacy Protection Guidelines:

Data Collection

This plugin does not collect user personal data. It only processes:

  • Website URLs provided by users for crawling
  • Public web content from target websites
  • User-configured crawling parameters (depth, limits, patterns)

All data processing is limited to publicly accessible web content and user-specified configuration parameters.

Privacy Policy

  • I confirm that I have prepared and included a privacy policy in my plugin package based on the Plugin Privacy Protection Guidelines

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/langgenius/dify-plugins/pull/1302 **Author:** [@amirasaran](https://github.com/amirasaran) **Created:** 9/28/2025 **Status:** ✅ Merged **Merged:** 10/5/2025 **Merged by:** [@crazywoola](https://github.com/crazywoola) **Base:** `main` ← **Head:** `main` --- ### 📝 Commits (1) - [`5155f03`](https://github.com/langgenius/dify-plugins/commit/5155f0363cc43cc219934fdeddb0ff8b856a9f9f) add WaterCrawl datasource plugin ### 📊 Changes **1 file changed** (+0 additions, -0 deletions) <details> <summary>View changed files</summary> ➕ `watercrawl/watercrawl_datasource/watercrawl-datasource-dify-plugin-v0.1.0.difypkg` (+0 -0) </details> ### 📄 Description ## 1. Metadata - **Plugin Author**: watercrawl - **Plugin Name**: watercrawl_datasource - **Repository URL**: https://github.com/watercrawl/watercrawl-datasource-dify-plugin ## 2. Submission Type - [x] New plugin submission ## 3. Description <!-- Please briefly describe the purpose of the new plugin or the updates made to the existing plugin --> The Watercrawl Datasource Plugin integrates with Watercrawl API to provide powerful web crawling capabilities for Dify workflows. It enables users to: - Recursively crawl websites with configurable depth and page limits - Extract clean, LLM-ready content from web pages with smart filtering - Use URL pattern matching to include/exclude specific sections - Support both fast crawling mode and comprehensive content extraction - Work with both Watercrawl cloud service and self-hosted instances - Output structured data with titles, descriptions, and markdown-formatted content This plugin is ideal for building knowledge bases, content analysis, documentation indexing, and competitor monitoring workflows. ## 4. Checklist - [x] I have read and followed the Publish to Dify Marketplace guidelines - [x] I have read and comply with the Plugin Developer Agreement - [x] I confirm my plugin works properly on both Dify Community Edition and Cloud Version - [x] I confirm my plugin has been thoroughly tested for completeness and functionality - [x] My plugin brings new value to Dify ## 5. Documentation Checklist Please confirm that your plugin README includes all necessary information: - [x] Step-by-step setup instructions - [x] Detailed usage instructions - [x] All required APIs and credentials are clearly listed - [x] Connection requirements and configuration details - [x] Link to the repository for the plugin source code ## 6. Privacy Protection Information Based on Dify Plugin Privacy Protection [Guidelines](https://docs.dify.ai/plugins/publish-plugins/publish-to-dify-marketplace/plugin-privacy-protection-guidelines): ### Data Collection <!-- Does your plugin collect any user personal data? If yes, please list what types of user personal data are being collected according to the Plugin Privacy Protection Guidelines (for example: Email address, IP address, Age, etc) --> This plugin does not collect user personal data. It only processes: - Website URLs provided by users for crawling - Public web content from target websites - User-configured crawling parameters (depth, limits, patterns) All data processing is limited to publicly accessible web content and user-specified configuration parameters. ### Privacy Policy - [x] I confirm that I have prepared and included a privacy policy in my plugin package based on the Plugin Privacy Protection Guidelines --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-22 18:00:25 -05:00
yindo closed this issue 2026-02-22 18:00:25 -05:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Plugin Request
Plugin Request
Plugin Request
bug
duplicate
enhancement
pull-request
Mirrored from GitHub Pull Request
 question
No Label pull-request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify-plugins#1518
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?