[PR #2025] [MERGED] feat: add Anakin web scraping and AI search plugin #2027

Closed
opened 2026-02-22 18:14:41 -05:00 by yindo · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/langgenius/dify-plugins/pull/2025
Author: @Viraal-Bambori
Created: 2/5/2026
Status: Merged
Merged: 2/6/2026
Merged by: @crazywoola

Base: mainHead: main


📝 Commits (3)

  • 96013c4 feat: add Anakin web scraping and AI search plugin
  • 0b21203 feat: add Anakin web scraping and AI search plugin
  • 1108ab3 updated-dify-plugin-version

📊 Changes

1 file changed (+0 additions, -0 deletions)

View changed files

anakin/anakin/anakin.difypkg (+0 -0)

📄 Description

Plugin Submission Form

1. Metadata

2. Submission Type

  • New plugin submission
  • Version update for existing plugin

3. Description

Anakin plugin provides enterprise-grade web scraping and AI-powered search capabilities for Dify workflows.

Key Features:

  • Anti-detection proxy routing across 207 countries
  • Intelligent caching (up to 30x faster on repeated requests)
  • AI extraction to convert any webpage into structured JSON
  • Browser automation with headless Chrome for JavaScript-heavy sites
  • Authenticated scraping with encrypted session storage (AES-256-GCM)

5 Tools Included:

  1. URL Scraper - Extract HTML, Markdown, and structured JSON from any URL
  2. Batch URL Scraper - Scrape up to 10 URLs simultaneously
  3. AI Search - Synchronous web search with relevance scoring and citations
  4. Deep Research - Multi-stage async research pipeline with AI synthesis
  5. Custom Web Scraper - Pre-configured extractors for domain-specific data

Built on the AnakinScraper API, this plugin enables AI applications to reliably extract data from any website while handling anti-bot protection automatically.

4. Checklist

  • I have read and followed the Publish to Dify Marketplace guidelines
  • I have read and comply with the Plugin Developer Agreement
  • I confirm my plugin works properly on both Dify Community Edition and Cloud Version
  • I confirm my plugin has been thoroughly tested for completeness and functionality
  • My plugin brings new value to Dify

5. Documentation Checklist

Please confirm that your plugin README includes all necessary information:

  • Step-by-step setup instructions
  • Detailed usage instructions
  • All required APIs and credentials are clearly listed
  • Connection requirements and configuration details
  • Link to the repository for the plugin source code

6. Privacy Protection Information

Based on Dify Plugin Privacy Protection Guidelines:

Data Collection

This plugin does not collect or store any user personal data. All data processing is transient - URLs and search queries are passed directly to the Anakin API and responses are returned to Dify without caching or logging.

Privacy Policy

  • I confirm that I have prepared and included a privacy policy in my plugin package based on the Plugin Privacy Protection Guidelines

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/langgenius/dify-plugins/pull/2025 **Author:** [@Viraal-Bambori](https://github.com/Viraal-Bambori) **Created:** 2/5/2026 **Status:** ✅ Merged **Merged:** 2/6/2026 **Merged by:** [@crazywoola](https://github.com/crazywoola) **Base:** `main` ← **Head:** `main` --- ### 📝 Commits (3) - [`96013c4`](https://github.com/langgenius/dify-plugins/commit/96013c44f174161907e754febd1223d096ec81c9) feat: add Anakin web scraping and AI search plugin - [`0b21203`](https://github.com/langgenius/dify-plugins/commit/0b21203d8dbab06a3eda8e11cce878dfc3ceff12) feat: add Anakin web scraping and AI search plugin - [`1108ab3`](https://github.com/langgenius/dify-plugins/commit/1108ab354761d0d4e16e5f8b5149c5e32aa76568) updated-dify-plugin-version ### 📊 Changes **1 file changed** (+0 additions, -0 deletions) <details> <summary>View changed files</summary> ➕ `anakin/anakin/anakin.difypkg` (+0 -0) </details> ### 📄 Description # Plugin Submission Form ## 1. Metadata <!-- Please provide the following metadata of your plugin to make it easier for the reviewer to check the changes. - Plugin Author : The author of the plugin which is defined in your manifest.yaml - Plugin Name : The name of the plugin which is defined in your manifest.yaml - Repository URL: The URL of the repository where the source code of your plugin is hosted --> - **Plugin Author**: anakin - **Plugin Name**: anakin - **Repository URL**: https://github.com/Anakin-Inc/anakin-dify-plugins/tree/main/anakin ## 2. Submission Type - [x] New plugin submission - [ ] Version update for existing plugin ## 3. Description <!-- Please briefly describe the purpose of the new plugin or the updates made to the existing plugin --> Anakin plugin provides enterprise-grade web scraping and AI-powered search capabilities for Dify workflows. **Key Features:** - Anti-detection proxy routing across 207 countries - Intelligent caching (up to 30x faster on repeated requests) - AI extraction to convert any webpage into structured JSON - Browser automation with headless Chrome for JavaScript-heavy sites - Authenticated scraping with encrypted session storage (AES-256-GCM) **5 Tools Included:** 1. **URL Scraper** - Extract HTML, Markdown, and structured JSON from any URL 2. **Batch URL Scraper** - Scrape up to 10 URLs simultaneously 3. **AI Search** - Synchronous web search with relevance scoring and citations 4. **Deep Research** - Multi-stage async research pipeline with AI synthesis 5. **Custom Web Scraper** - Pre-configured extractors for domain-specific data Built on the AnakinScraper API, this plugin enables AI applications to reliably extract data from any website while handling anti-bot protection automatically. ## 4. Checklist - [x] I have read and followed the Publish to Dify Marketplace guidelines - [x] I have read and comply with the Plugin Developer Agreement - [x] I confirm my plugin works properly on both Dify Community Edition and Cloud Version - [x] I confirm my plugin has been thoroughly tested for completeness and functionality - [x] My plugin brings new value to Dify ## 5. Documentation Checklist Please confirm that your plugin README includes all necessary information: - [x] Step-by-step setup instructions - [x] Detailed usage instructions - [x] All required APIs and credentials are clearly listed - [x] Connection requirements and configuration details - [x] Link to the repository for the plugin source code ## 6. Privacy Protection Information Based on Dify Plugin Privacy Protection [Guidelines](https://docs.dify.ai/plugins/publish-plugins/publish-to-dify-marketplace/plugin-privacy-protection-guidelines): ### Data Collection <!-- Does your plugin collect any user personal data? If yes, please list what types of user personal data are being collected according to the Plugin Privacy Protection Guidelines (for example: Email address, IP address, Age, etc) --> This plugin does not collect or store any user personal data. All data processing is transient - URLs and search queries are passed directly to the Anakin API and responses are returned to Dify without caching or logging. ### Privacy Policy - [x] I confirm that I have prepared and included a privacy policy in my plugin package based on the Plugin Privacy Protection Guidelines --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-22 18:14:41 -05:00
yindo closed this issue 2026-02-22 18:14:49 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify-plugins#2027