langgenius/dify-plugins
1
0
Fork 0
mirror of https://github.com/langgenius/dify-plugins.git synced 2026-07-22 01:55:36 -04:00
Code Issues 119 Packages Projects Releases Wiki Activity

[PR #653] [MERGED] Add Bright Data Web Scraper Plugin for Dify Marketplace #1087

New Issue
Closed
opened 2026-02-22 17:47:38 -05:00 by yindo · 0 comments
yindo commented 2026-02-22 17:47:38 -05:00
Owner
Copy Link
Copy Source

📋 Pull Request Information

Original PR: https://github.com/langgenius/dify-plugins/pull/653
Author: @Idanvilenski
Created: 6/9/2025
Status: ✅ Merged
Merged: 6/22/2025
Merged by: @crazywoola

Base: main ← Head: brightdata-plugin-submission

📝 Commits (2)

  • e36d4a6 Add Bright Data Web Scraper Plugin for Dify Marketplace
  • 1a33308 Merge branch 'langgenius:main' into brightdata-plugin-submission

📊 Changes

1 file changed (+0 additions, -0 deletions)

View changed files

➕ brightdata/brightdata-web-scraper/brightdata_plugin.difypkg (+0 -0)

📄 Description

Plugin Submission Form

1. Metadata

2. Submission Type

  • New plugin submission
  • Version update for existing plugin

3. Description

This plugin provides comprehensive web scraping and data extraction capabilities powered by Bright Data's enterprise-grade infrastructure. It supports 50+ platforms including major e-commerce sites (Amazon, eBay, Walmart), social media platforms (LinkedIn, Instagram, YouTube, TikTok), business intelligence sources (Crunchbase, ZoomInfo), and search engines.

Key Features:

  • Universal Web Scraping: Convert any webpage to clean markdown format
  • Structured Data Extraction: Pre-built extractors for 50+ popular platforms
  • Search Engine Integration: Get search results from Google, Bing, and Yandex
  • Enterprise-Grade Infrastructure: Advanced bot detection bypass capabilities
  • Cache-Optimized: Faster and more reliable results

Supported Platforms:

E-commerce (Amazon, eBay, Walmart, Best Buy, Etsy, Zara), Social Media (Instagram, Facebook, TikTok, YouTube, X), Professional Networks (LinkedIn), Business Intelligence (Crunchbase, ZoomInfo), Maps & Reviews (Google Maps, Booking), News (Reuters), App Stores (Google Play, Apple App Store), and Financial data (Yahoo Finance).

This plugin brings enterprise-grade web scraping capabilities to the Dify ecosystem, enabling users to build sophisticated data collection workflows without complex infrastructure setup.

4. Checklist

  • I have read and followed the Publish to Dify Marketplace guidelines
  • I have read and comply with the Plugin Developer Agreement
  • I confirm my plugin works properly on both Dify Community Edition and Cloud Version
  • I confirm my plugin has been thoroughly tested for completeness and functionality
  • My plugin brings new value to Dify

5. Documentation Checklist

Please confirm that your plugin README includes all necessary information:

  • Step-by-step setup instructions
  • Detailed usage instructions
  • All required APIs and credentials are clearly listed
  • Connection requirements and configuration details
  • Link to the repository for the plugin source code

6. Privacy Protection Information

Based on Dify Plugin Privacy Protection Guidelines:

Data Collection

This plugin does not collect any user personal data. The plugin processes user-provided URLs and search queries solely for web scraping purposes, handles publicly available web content temporarily during extraction, and securely manages Bright Data API credentials for authentication only. All data processing occurs in real-time and is not stored or retained.

Privacy Policy

  • I confirm that I have prepared and included a privacy policy in my plugin package based on the Plugin Privacy Protection Guidelines

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/langgenius/dify-plugins/pull/653 **Author:** [@Idanvilenski](https://github.com/Idanvilenski) **Created:** 6/9/2025 **Status:** ✅ Merged **Merged:** 6/22/2025 **Merged by:** [@crazywoola](https://github.com/crazywoola) **Base:** `main` ← **Head:** `brightdata-plugin-submission` --- ### 📝 Commits (2) - [`e36d4a6`](https://github.com/langgenius/dify-plugins/commit/e36d4a67d7ff5fea6c5d08fa8086882382c9c749) Add Bright Data Web Scraper Plugin for Dify Marketplace - [`1a33308`](https://github.com/langgenius/dify-plugins/commit/1a333086ae4d77dd45b426e7fd5e2ed7e768b8f4) Merge branch 'langgenius:main' into brightdata-plugin-submission ### 📊 Changes **1 file changed** (+0 additions, -0 deletions) <details> <summary>View changed files</summary> ➕ `brightdata/brightdata-web-scraper/brightdata_plugin.difypkg` (+0 -0) </details> ### 📄 Description # Plugin Submission Form ## 1. Metadata <!-- - Plugin Author : The author of the plugin which is defined in your manifest.yaml - Plugin Name : The name of the plugin which is defined in your manifest.yaml - Repository URL: https://github.com/brightdata/brightdata-dify-plugin --> - **Plugin Author**: Bright Data - **Plugin Name**: BrightData Web Scraper Plugin - **Repository URL**: https://github.com/brightdata/brightdata-dify-plugin ## 2. Submission Type - [x] New plugin submission - [ ] Version update for existing plugin ## 3. Description This plugin provides comprehensive web scraping and data extraction capabilities powered by Bright Data's enterprise-grade infrastructure. It supports 50+ platforms including major e-commerce sites (Amazon, eBay, Walmart), social media platforms (LinkedIn, Instagram, YouTube, TikTok), business intelligence sources (Crunchbase, ZoomInfo), and search engines. ### Key Features: - **Universal Web Scraping**: Convert any webpage to clean markdown format - **Structured Data Extraction**: Pre-built extractors for 50+ popular platforms - **Search Engine Integration**: Get search results from Google, Bing, and Yandex - **Enterprise-Grade Infrastructure**: Advanced bot detection bypass capabilities - **Cache-Optimized**: Faster and more reliable results ### Supported Platforms: E-commerce (Amazon, eBay, Walmart, Best Buy, Etsy, Zara), Social Media (Instagram, Facebook, TikTok, YouTube, X), Professional Networks (LinkedIn), Business Intelligence (Crunchbase, ZoomInfo), Maps & Reviews (Google Maps, Booking), News (Reuters), App Stores (Google Play, Apple App Store), and Financial data (Yahoo Finance). This plugin brings enterprise-grade web scraping capabilities to the Dify ecosystem, enabling users to build sophisticated data collection workflows without complex infrastructure setup. ## 4. Checklist - [x] I have read and followed the Publish to Dify Marketplace guidelines - [x] I have read and comply with the Plugin Developer Agreement - [x] I confirm my plugin works properly on both Dify Community Edition and Cloud Version - [x] I confirm my plugin has been thoroughly tested for completeness and functionality - [x] My plugin brings new value to Dify ## 5. Documentation Checklist Please confirm that your plugin README includes all necessary information: - [x] Step-by-step setup instructions - [x] Detailed usage instructions - [x] All required APIs and credentials are clearly listed - [x] Connection requirements and configuration details - [x] Link to the repository for the plugin source code ## 6. Privacy Protection Information Based on Dify Plugin Privacy Protection [Guidelines](https://docs.dify.ai/plugins/publish-plugins/publish-to-dify-marketplace/plugin-privacy-protection-guidelines): ### Data Collection This plugin does not collect any user personal data. The plugin processes user-provided URLs and search queries solely for web scraping purposes, handles publicly available web content temporarily during extraction, and securely manages Bright Data API credentials for authentication only. All data processing occurs in real-time and is not stored or retained. ### Privacy Policy - [x] I confirm that I have prepared and included a privacy policy in my plugin package based on the Plugin Privacy Protection Guidelines --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-22 17:47:38 -05:00
yindo closed this issue 2026-02-22 17:47:40 -05:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Plugin Request
Plugin Request
Plugin Request
bug
duplicate
enhancement
pull-request
Mirrored from GitHub Pull Request
 question
No Label pull-request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify-plugins#1087
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?