langgenius/dify
1
0
Fork 0
mirror of https://github.com/langgenius/dify.git synced 2026-08-28 05:20:07 -04:00
Code Issues 775 Packages Projects Releases 10 Wiki Activity

Browser automation instead of paid APIs #12772

New Issue
Closed
opened 2026-02-21 19:08:58 -05:00 by yindo · 5 comments
yindo commented 2026-02-21 19:08:58 -05:00
Owner
Copy Link
Copy Source

Originally created by @eiko4 on GitHub (Apr 10, 2025).

Self Checks

  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:)
  • Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

I want to thank you for the project, convenient settings for creating chains of agents and at the same time a normal UI for chats (I hope that later they will be like in open-webui).

Now to the problem.

Right now, I can't even ask Dify to search for where to order pizza without using a third-party api.

Why do I need to pay another company like spider.cloud or fastcrawl.dev for such a simple task?

2. Additional context or comments

What does the sandbox have to do with it?

Playwright can work inside docker.
Chrome Headless can also run in docker.

There is no computer use agent in your solution - to emulate a mouse (for this you need to raise firefox and ubuntu inside docker) - look at how anthropic did it.

But at least selenium/puppeteer/playwright should be added (via code, without emulation mouse).

By the way, these Features can be used as an example https://github.com/gptme/gptme?tab=readme-ov-file#-features.

In general, I would like to see more plugins and utilities in the Marketplace without using third-party APIs.

Thanks!

Originally created by @eiko4 on GitHub (Apr 10, 2025). ### Self Checks - [x] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [x] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:) - [x] Please do not modify this template :) and fill in all the required fields. ### 1. Is this request related to a challenge you're experiencing? Tell me about your story. I want to thank you for the project, convenient settings for creating chains of agents and at the same time a normal UI for chats (I hope that later they will be like in open-webui). Now to the problem. Right now, I can't even ask Dify to search for where to order pizza without using a third-party api. Why do I need to pay another company like spider.cloud or fastcrawl.dev for such a simple task? ### 2. Additional context or comments What does the sandbox have to do with it? Playwright can work inside docker. Chrome Headless can also run in docker. There is no computer use agent in your solution - to emulate a mouse (for this you need to raise firefox and ubuntu inside docker) - look at how [anthropic](https://github.com/anthropics/anthropic-quickstarts/tree/main/computer-use-demo) did it. But at least selenium/puppeteer/playwright should be added (via code, without emulation mouse). By the way, these **Features** can be used as an example https://github.com/gptme/gptme?tab=readme-ov-file#-features. In general, I would like to see more plugins and utilities in the **Marketplace** without using third-party APIs. Thanks!
yindo added the 🔨 feat:tools label 2026-02-21 19:08:58 -05:00
yindo closed this issue 2026-02-21 19:08:58 -05:00
yindo commented 2026-02-21 19:08:58 -05:00
Author
Owner
Copy Link
Copy Source

@crazywoola commented on GitHub (Apr 12, 2025):

You could try building a plugin like this. As far as I know, some websites have bot detection mechanisms in place, so it's not easy to build a general-purpose spider that can bypass them.

@crazywoola commented on GitHub (Apr 12, 2025): You could try building a plugin like this. As far as I know, some websites have bot detection mechanisms in place, so it's not easy to build a general-purpose spider that can bypass them.
yindo commented 2026-02-21 19:08:59 -05:00
Author
Owner
Copy Link
Copy Source

@dosubot[bot] commented on GitHub (May 14, 2025):

Hi, @eiko4. I'm Dosu, and I'm helping the Dify team manage their backlog. I'm marking this issue as stale.

Issue Summary:

  • You proposed integrating browser automation tools like Selenium, Puppeteer, or Playwright to reduce reliance on paid third-party APIs.
  • Suggested using these tools within Docker environments and expanding the Marketplace with plugins that don't require external APIs.
  • @crazywoola highlighted challenges due to bot detection mechanisms on websites, making a general-purpose spider difficult to implement.

Next Steps:

  • Please let me know if this issue is still relevant to the latest version of the Dify repository by commenting here.
  • If no updates are provided, this issue will be automatically closed in 15 days.

Thank you for your understanding and contribution!

@dosubot[bot] commented on GitHub (May 14, 2025): Hi, @eiko4. I'm [Dosu](https://dosu.dev), and I'm helping the Dify team manage their backlog. I'm marking this issue as stale. **Issue Summary:** - You proposed integrating browser automation tools like Selenium, Puppeteer, or Playwright to reduce reliance on paid third-party APIs. - Suggested using these tools within Docker environments and expanding the Marketplace with plugins that don't require external APIs. - @crazywoola highlighted challenges due to bot detection mechanisms on websites, making a general-purpose spider difficult to implement. **Next Steps:** - Please let me know if this issue is still relevant to the latest version of the Dify repository by commenting here. - If no updates are provided, this issue will be automatically closed in 15 days. Thank you for your understanding and contribution!
yindo commented 2026-02-21 19:08:59 -05:00
Author
Owner
Copy Link
Copy Source

@GitSarp commented on GitHub (May 16, 2025):

+1, like manus. it is cool!

@GitSarp commented on GitHub (May 16, 2025): +1, like manus. it is cool!
yindo commented 2026-02-21 19:08:59 -05:00
Author
Owner
Copy Link
Copy Source

@dosubot[bot] commented on GitHub (May 16, 2025):

@crazywoola, the user @GitSarp has indicated that the issue regarding integrating browser automation tools is still relevant. Could you please assist them with this?

@dosubot[bot] commented on GitHub (May 16, 2025): @crazywoola, the user @GitSarp has indicated that the issue regarding integrating browser automation tools is still relevant. Could you please assist them with this?
yindo commented 2026-02-21 19:08:59 -05:00
Author
Owner
Copy Link
Copy Source

@crazywoola commented on GitHub (Aug 2, 2025):

@crazywoola commented on GitHub (Aug 2, 2025): - https://marketplace.dify.ai/plugins/hjlarry/playwright - https://marketplace.dify.ai/plugins/anspire/anspire_browser_agent - https://marketplace.dify.ai/plugins/lysonober/browser-use-cloud
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Knowledge Pipeline
Proposal
WIP
cloud
dependencies
feat:webapp
good first issue
outdated
performance
pull-request
Mirrored from GitHub Pull Request
 python:uv
refactor
size:L
stale
status: accepting prs
status: blocked
status: in discussion
stt & tts
vulnerablity
web
wont-fix
🌊 feat:workflow
🌚 invalid
🐞 bug
👻 feat:rag
💪 enhancement
📚 documentation
🔨 feat:tools
🙋‍♂️ question
🙏 help wanted
🤔 cant-reproduce
🤖 feat:agent
No Label 🔨 feat:tools
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#12772
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?