WebFetch tool and Google - "Click here if you haven't been redirected." #8042

Open
opened 2026-02-16 18:08:59 -05:00 by yindo · 1 comment
Owner

Originally created by @ArfyFR on GitHub (Jan 30, 2026).

Originally assigned to: @thdxr on GitHub.

Question

Hi,
Since yesterday (using GPT-4.1 OpenAI) WebFetch seems to be blocked.
Is it a way to allow WebFetch on Google again ?

Here is the reply on my OpenCode:
Sure! Let me try using the webfetch tool to simulate a web search (similar to "WebSearch") and see what happens. I’ll use Google as the search engine to demonstrate this.
I will fetch a Google search for a test query: https://www.google.com/search?q=how+does+WebSearch+API+work and check if I am able to retrieve the results. Once I have the result (or if I encounter a failure), I’ll explain to you what happened and why.
Let’s begin by fetching this Google search URL.
% WebFetch https://www.google.com/search?q=how+does+WebSearch+API+work
The webfetch tool attempted to load the Google search results page, but instead of providing the actual content, Google returned a redirect page with instructions to "Click here if you haven't been redirected." This is a common anti-bot and web scraping defense.

Originally created by @ArfyFR on GitHub (Jan 30, 2026). Originally assigned to: @thdxr on GitHub. ### Question Hi, Since yesterday (using GPT-4.1 OpenAI) WebFetch seems to be blocked. Is it a way to allow WebFetch on Google again ? Here is the reply on my OpenCode: `Sure! Let me try using the webfetch tool to simulate a web search (similar to "WebSearch") and see what happens. I’ll use Google as the search engine to demonstrate this.` `I will fetch a Google search for a test query: https://www.google.com/search?q=how+does+WebSearch+API+work and check if I am able to retrieve the results. Once I have the result (or if I encounter a failure), I’ll explain to you what happened and why.` `Let’s begin by fetching this Google search URL.` `% WebFetch https://www.google.com/search?q=how+does+WebSearch+API+work` `The webfetch tool attempted to load the Google search results page, but instead of providing the actual content, Google returned a redirect page with instructions to "Click here if you haven't been redirected." This is a common anti-bot and web scraping defense.`
Author
Owner

@github-actions[bot] commented on GitHub (Jan 30, 2026):

This issue might be a duplicate of existing issues. Please check:

  • #10322: WebFetch returns 403 on sites with TLS fingerprint detection (Cloudflare protection blocking WebFetch)
  • #9013: Allow overriding WebFetch tool's User-Agent header (User-Agent may be detected as a bot)
  • #7445: webfetch allowed/blocked URLs (Feature request for WebFetch blocking management)

These issues indicate WebFetch has ongoing problems with anti-bot/anti-scraper protection on various websites (including Google). The redirect page with 'Click here if you haven't been redirected' is Google's specific implementation of bot detection.

Feel free to ignore if none of these address your specific case.

@github-actions[bot] commented on GitHub (Jan 30, 2026): This issue might be a duplicate of existing issues. Please check: - #10322: WebFetch returns 403 on sites with TLS fingerprint detection (Cloudflare protection blocking WebFetch) - #9013: Allow overriding WebFetch tool's User-Agent header (User-Agent may be detected as a bot) - #7445: webfetch allowed/blocked URLs (Feature request for WebFetch blocking management) These issues indicate WebFetch has ongoing problems with anti-bot/anti-scraper protection on various websites (including Google). The redirect page with 'Click here if you haven't been redirected' is Google's specific implementation of bot detection. Feel free to ignore if none of these address your specific case.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: anomalyco/opencode#8042