langgenius/dify-plugins
1
0
Fork 0
mirror of https://github.com/langgenius/dify-plugins.git synced 2026-07-22 01:55:36 -04:00
Code Issues 119 Packages Projects Releases Wiki Activity

[PR #2021] [CLOSED] feat: add Anakin web scraping and AI search plugin #2024

New Issue
Closed
opened 2026-02-22 18:14:34 -05:00 by yindo · 0 comments
yindo commented 2026-02-22 18:14:34 -05:00
Owner
Copy Link
Copy Source

📋 Pull Request Information

Original PR: https://github.com/langgenius/dify-plugins/pull/2021
Author: @Viraal-Bambori
Created: 2/5/2026
Status: ❌ Closed

Base: main ← Head: main

📝 Commits (3)

  • 5b0d612 feat: add Anakin web scraping and AI search plugin
  • e719840 feat: add Anakin web scraping and AI search plugin
  • 82ee163 chore: add plugin package file

📊 Changes

24 files changed (+1775 additions, -0 deletions)

View changed files

➕ anakin/anakin/.difyignore (+184 -0)
➕ anakin/anakin/.env.example (+3 -0)
➕ anakin/anakin/.github/workflows/plugin-publish.yml (+109 -0)
➕ anakin/anakin/.gitignore (+176 -0)
➕ anakin/anakin/GUIDE.md (+137 -0)
➕ anakin/anakin/PRIVACY.md (+92 -0)
➕ anakin/anakin/README.md (+194 -0)
➕ anakin/anakin/_assets/anakintech_logo.png (+0 -0)
➕ anakin/anakin/anakin.difypkg (+0 -0)
➕ anakin/anakin/main.py (+6 -0)
➕ anakin/anakin/manifest.yaml (+37 -0)
➕ anakin/anakin/provider/anakin.py (+20 -0)
➕ anakin/anakin/provider/anakin.yaml (+44 -0)
➕ anakin/anakin/requirements.txt (+2 -0)
➕ anakin/anakin/tools/agentic_search.py (+85 -0)
➕ anakin/anakin/tools/agentic_search.yaml (+34 -0)
➕ anakin/anakin/tools/batch_scraper.py (+103 -0)
➕ anakin/anakin/tools/batch_scraper.yaml (+82 -0)
➕ anakin/anakin/tools/search.py (+55 -0)
➕ anakin/anakin/tools/search.yaml (+50 -0)

...and 4 more files

📄 Description

Plugin Submission Form

1. Metadata

2. Submission Type

  • New plugin submission
  • Version update for existing plugin

3. Description

Anakin plugin provides enterprise-grade web scraping and AI-powered search capabilities for Dify workflows.

Key Features:

  • Anti-detection proxy routing across 207 countries
  • Intelligent caching (up to 30x faster on repeated requests)
  • AI extraction to convert any webpage into structured JSON
  • Browser automation with headless Chrome for JavaScript-heavy sites
  • Authenticated scraping with encrypted session storage (AES-256-GCM)

5 Tools Included:

  1. URL Scraper - Extract HTML, Markdown, and structured JSON from any URL
  2. Batch URL Scraper - Scrape up to 10 URLs simultaneously
  3. AI Search - Synchronous web search with relevance scoring and citations
  4. Deep Research - Multi-stage async research pipeline with AI synthesis
  5. Custom Web Scraper - Pre-configured extractors for domain-specific data

Built on the AnakinScraper API, this plugin enables AI applications to reliably extract data from any website while handling anti-bot protection automatically.

4. Checklist

  • I have read and followed the Publish to Dify Marketplace guidelines
  • I have read and comply with the Plugin Developer Agreement
  • I confirm my plugin works properly on both Dify Community Edition and Cloud Version
  • I confirm my plugin has been thoroughly tested for completeness and functionality
  • My plugin brings new value to Dify

5. Documentation Checklist

Please confirm that your plugin README includes all necessary information:

  • Step-by-step setup instructions
  • Detailed usage instructions
  • All required APIs and credentials are clearly listed
  • Connection requirements and configuration details
  • Link to the repository for the plugin source code

6. Privacy Protection Information

Based on Dify Plugin Privacy Protection Guidelines:

Data Collection

This plugin does not collect or store any user personal data. All data processing is transient - URLs and search queries are passed directly to the Anakin API and responses are returned to Dify without caching or logging.

Privacy Policy

  • I confirm that I have prepared and included a privacy policy in my plugin package based on the Plugin Privacy Protection Guidelines

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/langgenius/dify-plugins/pull/2021 **Author:** [@Viraal-Bambori](https://github.com/Viraal-Bambori) **Created:** 2/5/2026 **Status:** ❌ Closed **Base:** `main` ← **Head:** `main` --- ### 📝 Commits (3) - [`5b0d612`](https://github.com/langgenius/dify-plugins/commit/5b0d6122b867c6d91f2e568b97d1f7800f02a03a) feat: add Anakin web scraping and AI search plugin - [`e719840`](https://github.com/langgenius/dify-plugins/commit/e719840b851c359673629fdd02305a2f2ed722b6) feat: add Anakin web scraping and AI search plugin - [`82ee163`](https://github.com/langgenius/dify-plugins/commit/82ee1638c256c89095c133cbbafd6cbdaef8b5de) chore: add plugin package file ### 📊 Changes **24 files changed** (+1775 additions, -0 deletions) <details> <summary>View changed files</summary> ➕ `anakin/anakin/.difyignore` (+184 -0) ➕ `anakin/anakin/.env.example` (+3 -0) ➕ `anakin/anakin/.github/workflows/plugin-publish.yml` (+109 -0) ➕ `anakin/anakin/.gitignore` (+176 -0) ➕ `anakin/anakin/GUIDE.md` (+137 -0) ➕ `anakin/anakin/PRIVACY.md` (+92 -0) ➕ `anakin/anakin/README.md` (+194 -0) ➕ `anakin/anakin/_assets/anakintech_logo.png` (+0 -0) ➕ `anakin/anakin/anakin.difypkg` (+0 -0) ➕ `anakin/anakin/main.py` (+6 -0) ➕ `anakin/anakin/manifest.yaml` (+37 -0) ➕ `anakin/anakin/provider/anakin.py` (+20 -0) ➕ `anakin/anakin/provider/anakin.yaml` (+44 -0) ➕ `anakin/anakin/requirements.txt` (+2 -0) ➕ `anakin/anakin/tools/agentic_search.py` (+85 -0) ➕ `anakin/anakin/tools/agentic_search.yaml` (+34 -0) ➕ `anakin/anakin/tools/batch_scraper.py` (+103 -0) ➕ `anakin/anakin/tools/batch_scraper.yaml` (+82 -0) ➕ `anakin/anakin/tools/search.py` (+55 -0) ➕ `anakin/anakin/tools/search.yaml` (+50 -0) _...and 4 more files_ </details> ### 📄 Description # Plugin Submission Form ## 1. Metadata <!-- Please provide the following metadata of your plugin to make it easier for the reviewer to check the changes. - Plugin Author : The author of the plugin which is defined in your manifest.yaml - Plugin Name : The name of the plugin which is defined in your manifest.yaml - Repository URL: The URL of the repository where the source code of your plugin is hosted --> - **Plugin Author**: anakin - **Plugin Name**: anakin - **Repository URL**: https://github.com/Anakin-Inc/dify-plugins/tree/main/anakin/anakin ## 2. Submission Type - [x] New plugin submission - [ ] Version update for existing plugin ## 3. Description <!-- Please briefly describe the purpose of the new plugin or the updates made to the existing plugin --> Anakin plugin provides enterprise-grade web scraping and AI-powered search capabilities for Dify workflows. **Key Features:** - Anti-detection proxy routing across 207 countries - Intelligent caching (up to 30x faster on repeated requests) - AI extraction to convert any webpage into structured JSON - Browser automation with headless Chrome for JavaScript-heavy sites - Authenticated scraping with encrypted session storage (AES-256-GCM) **5 Tools Included:** 1. **URL Scraper** - Extract HTML, Markdown, and structured JSON from any URL 2. **Batch URL Scraper** - Scrape up to 10 URLs simultaneously 3. **AI Search** - Synchronous web search with relevance scoring and citations 4. **Deep Research** - Multi-stage async research pipeline with AI synthesis 5. **Custom Web Scraper** - Pre-configured extractors for domain-specific data Built on the AnakinScraper API, this plugin enables AI applications to reliably extract data from any website while handling anti-bot protection automatically. ## 4. Checklist - [x] I have read and followed the Publish to Dify Marketplace guidelines - [x] I have read and comply with the Plugin Developer Agreement - [x] I confirm my plugin works properly on both Dify Community Edition and Cloud Version - [x] I confirm my plugin has been thoroughly tested for completeness and functionality - [x] My plugin brings new value to Dify ## 5. Documentation Checklist Please confirm that your plugin README includes all necessary information: - [x] Step-by-step setup instructions - [x] Detailed usage instructions - [x] All required APIs and credentials are clearly listed - [x] Connection requirements and configuration details - [x] Link to the repository for the plugin source code ## 6. Privacy Protection Information Based on Dify Plugin Privacy Protection [Guidelines](https://docs.dify.ai/plugins/publish-plugins/publish-to-dify-marketplace/plugin-privacy-protection-guidelines): ### Data Collection <!-- Does your plugin collect any user personal data? If yes, please list what types of user personal data are being collected according to the Plugin Privacy Protection Guidelines (for example: Email address, IP address, Age, etc) --> This plugin does not collect or store any user personal data. All data processing is transient - URLs and search queries are passed directly to the Anakin API and responses are returned to Dify without caching or logging. ### Privacy Policy - [x] I confirm that I have prepared and included a privacy policy in my plugin package based on the Plugin Privacy Protection Guidelines --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-22 18:14:34 -05:00
yindo closed this issue 2026-02-22 18:14:34 -05:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Plugin Request
Plugin Request
Plugin Request
bug
duplicate
enhancement
pull-request
Mirrored from GitHub Pull Request
 question
No Label pull-request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify-plugins#2024
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?