[GH-ISSUE #746] [FEAT]: Live web-browsing for context #431

Closed
opened 2026-02-22 18:19:27 -05:00 by yindo · 4 comments
Owner

Originally created by @timothycarambat on GitHub (Feb 17, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/746

What would you like to see?

As a user, if my prompt results in no contextual documents from my vector database I should be able to have the LLM then search the internet for possible results to my query using a traditional search engine.

This is an opt-in feature that can be configured at the system level and enabled per workspace. This feature can only be enabled by admins/managers.

Providers:

  • Default (web-scraper) - Subject to random failure, captchas, and other issues
  • Google SERP API (free for ~1K calls) - Requires API key setup but is totally free Reference
  • ????? (please leave comment if you see this issue to suggest provider)
Originally created by @timothycarambat on GitHub (Feb 17, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/746 ### What would you like to see? As a user, if my prompt results in no contextual documents from my vector database I should be able to have the LLM then search the internet for possible results to my query using a traditional search engine. This is an opt-in feature that can be configured at the system level and enabled _per workspace_. This feature can only be enabled by admins/managers. Providers: - Default (web-scraper) - Subject to random failure, captchas, and other issues - Google SERP API (free for ~1K calls) - Requires API key setup but is totally free [Reference](https://developers.google.com/custom-search/v1/overview) - `?????` (please leave comment if you see this issue to suggest provider)
yindo added the enhancementfeature request labels 2026-02-22 18:19:27 -05:00
yindo closed this issue 2026-02-22 18:19:27 -05:00
Author
Owner

@sumitsodhi88 commented on GitHub (Feb 18, 2024):

better if the queries are encrypted/ chunked into smaller queries so as to maintain privacy.

@sumitsodhi88 commented on GitHub (Feb 18, 2024): better if the queries are encrypted/ chunked into smaller queries so as to maintain privacy.
Author
Owner

@dumengnan commented on GitHub (Feb 19, 2024):

This is a very useful feature, maybe it would be better to use the google search api, web scrapers might get out of control.
If live web-browsing is added, is it necessary to classify the user's questions and identify whether the user wants to call the knowledge base, perform a web search, or directly talk to llm?

@dumengnan commented on GitHub (Feb 19, 2024): This is a very useful feature, maybe it would be better to use the google search api, web scrapers might get out of control. If live web-browsing is added, is it necessary to classify the user's questions and identify whether the user wants to call the knowledge base, perform a web search, or directly talk to llm?
Author
Owner

@DanSt commented on GitHub (Feb 27, 2024):

How about the DuckDuckGo SerpAPI? https://serpapi.com/duckduckgo-search-api

@DanSt commented on GitHub (Feb 27, 2024): How about the DuckDuckGo SerpAPI? https://serpapi.com/duckduckgo-search-api
Author
Owner

@theEricDevelops commented on GitHub (Apr 10, 2024):

The Hugging Face Chat UI allows web content with these methods: SERP API, SERPER API, SERPSTACK API, LOCAL WEBSEARCH, SEARXNG (this is the one I'm trying via https://search.ericdevelops.com), and YOU API.

@theEricDevelops commented on GitHub (Apr 10, 2024): The Hugging Face Chat UI allows web content with these methods: SERP API, SERPER API, SERPSTACK API, LOCAL WEBSEARCH, SEARXNG (this is the one I'm trying via [https://search.ericdevelops.com](https://search.ericdevelops.com)), and YOU API.
yindo changed title from [FEAT]: Live web-browsing for context to [GH-ISSUE #746] [FEAT]: Live web-browsing for context 2026-06-05 14:35:16 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#431