langgenius/dify-plugins
1
0
Fork 0
mirror of https://github.com/langgenius/dify-plugins.git synced 2026-07-22 01:55:36 -04:00
Code Issues 119 Packages Projects Releases Wiki Activity

[PR #780] [CLOSED] Add Bright Data plugin update - Follow-up on PR #653 #1170

New Issue
Closed
opened 2026-02-22 17:50:03 -05:00 by yindo · 0 comments
yindo commented 2026-02-22 17:50:03 -05:00
Owner
Copy Link
Copy Source

📋 Pull Request Information

Original PR: https://github.com/langgenius/dify-plugins/pull/780
Author: @Idanvilenski
Created: 6/26/2025
Status: ❌ Closed

Base: main ← Head: brightdata-plugin-update

📝 Commits (10+)

📊 Changes

17 files changed (+1178 additions, -0 deletions)

View changed files

➕ BrightData/brightdata-dify-plugin/LICENSE (+43 -0)
➕ BrightData/brightdata-dify-plugin/PRIVACY.md (+40 -0)
➕ BrightData/brightdata-dify-plugin/README.md (+61 -0)
➕ BrightData/brightdata-dify-plugin/assets/demo1.PNG (+1 -0)
➕ BrightData/brightdata-dify-plugin/brightdata_plugin.difypkg (+0 -0)
➕ BrightData/brightdata-dify-plugin/brightdata_plugin/_assets/icon.svg (+1 -0)
➕ BrightData/brightdata-dify-plugin/brightdata_plugin/main.py (+6 -0)
➕ BrightData/brightdata-dify-plugin/brightdata_plugin/manifest.yaml (+41 -0)
➕ BrightData/brightdata-dify-plugin/brightdata_plugin/provider/brightdata.py (+20 -0)
➕ BrightData/brightdata-dify-plugin/brightdata_plugin/provider/brightdata.yaml (+36 -0)
➕ BrightData/brightdata-dify-plugin/brightdata_plugin/requirements.txt (+2 -0)
➕ BrightData/brightdata-dify-plugin/brightdata_plugin/tools/scrape_as_markdown.py (+57 -0)
➕ BrightData/brightdata-dify-plugin/brightdata_plugin/tools/scrape_as_markdown.yaml (+38 -0)
➕ BrightData/brightdata-dify-plugin/brightdata_plugin/tools/search_engine.py (+75 -0)
➕ BrightData/brightdata-dify-plugin/brightdata_plugin/tools/search_engine.yaml (+69 -0)
➕ BrightData/brightdata-dify-plugin/brightdata_plugin/tools/structured_data_feeds.py (+638 -0)
➕ BrightData/brightdata-dify-plugin/brightdata_plugin/tools/structured_data_feeds.yaml (+50 -0)

📄 Description

Updated README.md and manifest files to contain the relevant information for the plugin description and instructions on the Dify marketplace. Follow-up on PR #653

Plugin Submission Form

1. Metadata

2. Submission Type

  • [] New plugin submission
  • Version update for existing plugin

3. Description

This plugin provides comprehensive web scraping and data extraction capabilities powered by Bright Data's enterprise-grade infrastructure. It supports 50+ platforms including major e-commerce sites (Amazon, eBay, Walmart), social media platforms (LinkedIn, Instagram, YouTube, TikTok), business intelligence sources (Crunchbase, ZoomInfo), and search engines.

Key Features:

  • Universal Web Scraping: Convert any webpage to clean markdown format
  • Structured Data Extraction: Pre-built extractors for 50+ popular platforms
  • Search Engine Integration: Get search results from Google, Bing, and Yandex
  • Enterprise-Grade Infrastructure: Advanced bot detection bypass capabilities
  • Cache-Optimized: Faster and more reliable results

Supported Platforms:

E-commerce (Amazon, eBay, Walmart, Best Buy, Etsy, Zara), Social Media (Instagram, Facebook, TikTok, YouTube, X), Professional Networks (LinkedIn), Business Intelligence (Crunchbase, ZoomInfo), Maps & Reviews (Google Maps, Booking), News (Reuters), App Stores (Google Play, Apple App Store), and Financial data (Yahoo Finance).

This plugin brings enterprise-grade web scraping capabilities to the Dify ecosystem, enabling users to build sophisticated data collection workflows without complex infrastructure setup.

4. Checklist

  • I have read and followed the Publish to Dify Marketplace guidelines
  • I have read and comply with the Plugin Developer Agreement
  • I confirm my plugin works properly on both Dify Community Edition and Cloud Version
  • I confirm my plugin has been thoroughly tested for completeness and functionality
  • My plugin brings new value to Dify

5. Documentation Checklist

Please confirm that your plugin README includes all necessary information:

  • Step-by-step setup instructions
  • Detailed usage instructions
  • All required APIs and credentials are clearly listed
  • Connection requirements and configuration details
  • Link to the repository for the plugin source code

6. Privacy Protection Information

Based on Dify Plugin Privacy Protection Guidelines:

Data Collection

This plugin does not collect any user personal data. The plugin processes user-provided URLs and search queries solely for web scraping purposes, handles publicly available web content temporarily during extraction, and securely manages Bright Data API credentials for authentication only. All data processing occurs in real-time and is not stored or retained.

Privacy Policy

  • I confirm that I have prepared and included a privacy policy in my plugin package based on the Plugin Privacy Protection Guidelines

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/langgenius/dify-plugins/pull/780 **Author:** [@Idanvilenski](https://github.com/Idanvilenski) **Created:** 6/26/2025 **Status:** ❌ Closed **Base:** `main` ← **Head:** `brightdata-plugin-update` --- ### 📝 Commits (10+) - [`9bd3116`](https://github.com/langgenius/dify-plugins/commit/9bd311683d9fa032d9d014ff801043c8bbf34eae) Create LICENSE - [`5e7c987`](https://github.com/langgenius/dify-plugins/commit/5e7c9873d6b2ab2688ea80aa1b434b9d09c774d2) Add files via upload - [`3fe755b`](https://github.com/langgenius/dify-plugins/commit/3fe755be9256050f0c965a4bcd780b9eadd7e27b) Rename brightdata_plugin (1).difypkg to brightdata_plugin.difypkg - [`51fab1f`](https://github.com/langgenius/dify-plugins/commit/51fab1fdc73b8ce9f430095cb0ef444b17db406d) Create PRIVACY.md - [`d68ce9f`](https://github.com/langgenius/dify-plugins/commit/d68ce9f0101a501093f35fb3720a58bd96030e6e) Create GUIDE.md - [`57931ea`](https://github.com/langgenius/dify-plugins/commit/57931ea1e684f2d3e6bdb076b3cae5e40c4cff88) Create README.md - [`ddc0a29`](https://github.com/langgenius/dify-plugins/commit/ddc0a29a138b1db88453b885c5a2347c6e0304de) Create demo1.PNG - [`f0fce4e`](https://github.com/langgenius/dify-plugins/commit/f0fce4e4b603f97a7a533ad53d31e0564aaa941c) Create search_engine.yaml - [`c935b50`](https://github.com/langgenius/dify-plugins/commit/c935b50c770ecaf54d45e928146af8f33f06b1ce) Add files via upload - [`43363ca`](https://github.com/langgenius/dify-plugins/commit/43363ca0aaf806da10d2cc1a7e7a4548e8d97c9a) Create bright-data.yaml ### 📊 Changes **17 files changed** (+1178 additions, -0 deletions) <details> <summary>View changed files</summary> ➕ `BrightData/brightdata-dify-plugin/LICENSE` (+43 -0) ➕ `BrightData/brightdata-dify-plugin/PRIVACY.md` (+40 -0) ➕ `BrightData/brightdata-dify-plugin/README.md` (+61 -0) ➕ `BrightData/brightdata-dify-plugin/assets/demo1.PNG` (+1 -0) ➕ `BrightData/brightdata-dify-plugin/brightdata_plugin.difypkg` (+0 -0) ➕ `BrightData/brightdata-dify-plugin/brightdata_plugin/_assets/icon.svg` (+1 -0) ➕ `BrightData/brightdata-dify-plugin/brightdata_plugin/main.py` (+6 -0) ➕ `BrightData/brightdata-dify-plugin/brightdata_plugin/manifest.yaml` (+41 -0) ➕ `BrightData/brightdata-dify-plugin/brightdata_plugin/provider/brightdata.py` (+20 -0) ➕ `BrightData/brightdata-dify-plugin/brightdata_plugin/provider/brightdata.yaml` (+36 -0) ➕ `BrightData/brightdata-dify-plugin/brightdata_plugin/requirements.txt` (+2 -0) ➕ `BrightData/brightdata-dify-plugin/brightdata_plugin/tools/scrape_as_markdown.py` (+57 -0) ➕ `BrightData/brightdata-dify-plugin/brightdata_plugin/tools/scrape_as_markdown.yaml` (+38 -0) ➕ `BrightData/brightdata-dify-plugin/brightdata_plugin/tools/search_engine.py` (+75 -0) ➕ `BrightData/brightdata-dify-plugin/brightdata_plugin/tools/search_engine.yaml` (+69 -0) ➕ `BrightData/brightdata-dify-plugin/brightdata_plugin/tools/structured_data_feeds.py` (+638 -0) ➕ `BrightData/brightdata-dify-plugin/brightdata_plugin/tools/structured_data_feeds.yaml` (+50 -0) </details> ### 📄 Description Updated README.md and manifest files to contain the relevant information for the plugin description and instructions on the Dify marketplace. Follow-up on PR #653 # Plugin Submission Form ## 1. Metadata <!-- Please provide the following metadata of your plugin to make it easier for the reviewer to check the changes. - Plugin Author : The author of the plugin which is defined in your manifest.yaml - Plugin Name : The name of the plugin which is defined in your manifest.yaml - Repository URL: The URL of the repository where the source code of your plugin is hosted --> - **Plugin Author**: Bright Data - **Plugin Name**: BrightData Web Scraper Plugin - **Repository URL**: https://github.com/brightdata/brightdata-dify-plugin ## 2. Submission Type - [] New plugin submission - [x] Version update for existing plugin ## 3. Description This plugin provides comprehensive web scraping and data extraction capabilities powered by Bright Data's enterprise-grade infrastructure. It supports 50+ platforms including major e-commerce sites (Amazon, eBay, Walmart), social media platforms (LinkedIn, Instagram, YouTube, TikTok), business intelligence sources (Crunchbase, ZoomInfo), and search engines. ### Key Features: - **Universal Web Scraping**: Convert any webpage to clean markdown format - **Structured Data Extraction**: Pre-built extractors for 50+ popular platforms - **Search Engine Integration**: Get search results from Google, Bing, and Yandex - **Enterprise-Grade Infrastructure**: Advanced bot detection bypass capabilities - **Cache-Optimized**: Faster and more reliable results ### Supported Platforms: E-commerce (Amazon, eBay, Walmart, Best Buy, Etsy, Zara), Social Media (Instagram, Facebook, TikTok, YouTube, X), Professional Networks (LinkedIn), Business Intelligence (Crunchbase, ZoomInfo), Maps & Reviews (Google Maps, Booking), News (Reuters), App Stores (Google Play, Apple App Store), and Financial data (Yahoo Finance). This plugin brings enterprise-grade web scraping capabilities to the Dify ecosystem, enabling users to build sophisticated data collection workflows without complex infrastructure setup. ## 4. Checklist - [x] I have read and followed the Publish to Dify Marketplace guidelines - [x] I have read and comply with the Plugin Developer Agreement - [x] I confirm my plugin works properly on both Dify Community Edition and Cloud Version - [x] I confirm my plugin has been thoroughly tested for completeness and functionality - [x] My plugin brings new value to Dify ## 5. Documentation Checklist Please confirm that your plugin README includes all necessary information: - [x] Step-by-step setup instructions - [x] Detailed usage instructions - [x] All required APIs and credentials are clearly listed - [x] Connection requirements and configuration details - [x] Link to the repository for the plugin source code ## 6. Privacy Protection Information Based on Dify Plugin Privacy Protection [Guidelines](https://docs.dify.ai/plugins/publish-plugins/publish-to-dify-marketplace/plugin-privacy-protection-guidelines): ### Data Collection This plugin does not collect any user personal data. The plugin processes user-provided URLs and search queries solely for web scraping purposes, handles publicly available web content temporarily during extraction, and securely manages Bright Data API credentials for authentication only. All data processing occurs in real-time and is not stored or retained. ### Privacy Policy - [x] I confirm that I have prepared and included a privacy policy in my plugin package based on the Plugin Privacy Protection Guidelines --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-22 17:50:03 -05:00
yindo closed this issue 2026-02-22 17:50:04 -05:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Plugin Request
Plugin Request
Plugin Request
bug
duplicate
enhancement
pull-request
Mirrored from GitHub Pull Request
 question
No Label pull-request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify-plugins#1170
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?