Mintplex-Labs/anything-llm
1
0
Fork 0
mirror of https://github.com/Mintplex-Labs/anything-llm.git synced 2026-07-19 14:13:35 -04:00
Code Issues 328 Packages Projects Releases 10 Wiki Activity

[GH-ISSUE #5212] [BUG]: No content found at this URL #4969

New Issue
Closed
opened 2026-06-05 14:51:11 -04:00 by yindo · 5 comments
yindo commented 2026-06-05 14:51:11 -04:00
Owner
Copy Link
Copy Source

Originally created by @bulrush15 on GitHub (Mar 15, 2026).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/5212

How are you running AnythingLLM?

AnythingLLM desktop app

What happened?

Anything LLM Desktop v1.10 on Windows 11. I use this at home. I do not have a VPN.

I got an error like "No content found at this URL" for this: https://custommapposter.com/articles/what-companies-are-pulling-out-of-china/1781 This URL shows content in Brave browser just fine.

Screenshot:

Image

I do not use a VPN. My ad blocker is on for this site in the browser but that should only affect the browser not AnythingLLM.

Are there known steps to reproduce?

  1. Make a RAG AI of type "query" for the workspace setting.
  2. Fetch this website: https://custommapposter.com/articles/what-companies-are-pulling-out-of-china/1781
  3. You should get an error.
Originally created by @bulrush15 on GitHub (Mar 15, 2026). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/5212 ### How are you running AnythingLLM? AnythingLLM desktop app ### What happened? Anything LLM Desktop v1.10 on Windows 11. I use this at home. I do not have a VPN. I got an error like "No content found at this URL" for this: https://custommapposter.com/articles/what-companies-are-pulling-out-of-china/1781 This URL shows content in Brave browser just fine. Screenshot: <img width="464" height="251" alt="Image" src="https://github.com/user-attachments/assets/0951b02f-8b7f-4fdb-9aa0-d8c477d70005" /> I do not use a VPN. My ad blocker is on for this site in the browser but that should only affect the browser not AnythingLLM. ### Are there known steps to reproduce? 1. Make a RAG AI of type "query" for the workspace setting. 2. Fetch this website: https://custommapposter.com/articles/what-companies-are-pulling-out-of-china/1781 3. You should get an error.
yindo added the possible buginvestigating labels 2026-06-05 14:51:12 -04:00
yindo closed this issue 2026-06-05 14:51:12 -04:00
yindo commented 2026-06-05 14:51:12 -04:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (Mar 16, 2026):

Make a RAG AI of type "query" for the workspace setting.

If you are using query mode for a workspace, this will not fetch a website dynamically. To fetch a website in real time you need to be in an @agent session.

Can you reattach your screenshots? They are not showing in the issue so its hard to see what is being shown for the error so we can trace where the issue is.

Closing only for now until more information is available to action on.

<!-- gh-comment-id:4068754192 --> @timothycarambat commented on GitHub (Mar 16, 2026): > Make a RAG AI of type "query" for the workspace setting. If you are using `query` mode for a workspace, this will not fetch a website dynamically. To fetch a website in real time you need to be in an `@agent` session. Can you reattach your screenshots? They are not showing in the issue so its hard to see what is being shown for the error so we can trace where the issue is. Closing only for now until more information is available to action on.
yindo commented 2026-06-05 14:51:12 -04:00
Author
Owner
Copy Link
Copy Source

@bulrush15 commented on GitHub (Mar 17, 2026):

In query mode for a workspace this fetches all other URLs just fine except this one. I just enter the URL and click the "Fetch website" button. Here's what the error said and the problematic URL.

"Error uploading link: No URL content found at https://custommapposter.com/articles/what-companies-are-pulling-out-of-china/1781"

When I use a browser to go to the URL a popup window on the page blocks content. The popup said something like "Please turn off your ad blocker." Maybe that's the problem. The program should fail gracefully in these cases and be specific about what the error is.

Image

When I write programs I code the word "ERROR" to have a meaningful but unique code. In this case I might have the error message be "ERROR-fetchwebsite: No content found at URL." This makes searching for the error message quick and easy even among multiple source code files. 🙂

<!-- gh-comment-id:4073450778 --> @bulrush15 commented on GitHub (Mar 17, 2026): In query mode for a workspace this fetches all other URLs just fine except this one. I just enter the URL and click the "Fetch website" button. Here's what the error said and the problematic URL. > "Error uploading link: No URL content found at https://custommapposter.com/articles/what-companies-are-pulling-out-of-china/1781" When I use a browser to go to the URL a popup window on the page blocks content. The popup said something like "Please turn off your ad blocker." Maybe that's the problem. The program should fail gracefully in these cases and be specific about what the error is. <img width="655" height="243" alt="Image" src="https://github.com/user-attachments/assets/66fbc0de-174e-47b7-814a-7302cd5ac69c" /> When I write programs I code the word "ERROR" to have a meaningful but unique code. In this case I might have the error message be "ERROR-fetchwebsite: No content found at URL." This makes searching for the error message quick and easy even among multiple source code files. 🙂
yindo commented 2026-06-05 14:51:12 -04:00
Author
Owner
Copy Link
Copy Source

@bulrush15 commented on GitHub (Mar 17, 2026):

OMG, as I view this website in a browser there are so many intrusive popup ads. The website seems to load a new ad every 5 seconds or so. This may cause problems for AnythingLLM when trying to fetch the URL.

This might be the URL that causes AnythingLLM to hang for about 60+ seconds, and then crash, and it never freed up the memory it was using in Windows 11 either. But I never reported the crash since I wasn't sure which URL it was fetching was the problem.

<!-- gh-comment-id:4073482994 --> @bulrush15 commented on GitHub (Mar 17, 2026): OMG, as I view this website in a browser there are so many intrusive popup ads. The website seems to load a new ad every 5 seconds or so. This may cause problems for AnythingLLM when trying to fetch the URL. This might be the URL that causes AnythingLLM to hang for about 60+ seconds, and then crash, and it never freed up the memory it was using in Windows 11 either. But I never reported the crash since I wasn't sure which URL it was fetching was the problem.
yindo commented 2026-06-05 14:51:12 -04:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (Mar 17, 2026):

The reason for that is that we run a timeout (just for cases like this) where we wait for idle status within reason for a site. That is why it is timing out because if we try to scrape it all you will see are ads since it keeps spamming network requests

<!-- gh-comment-id:4076014461 --> @timothycarambat commented on GitHub (Mar 17, 2026): The reason for that is that we run a timeout (just for cases like this) where we wait for `idle` status within reason for a site. That is why it is timing out because if we try to scrape it all you will see are ads since it keeps spamming network requests
yindo commented 2026-06-05 14:51:13 -04:00
Author
Owner
Copy Link
Copy Source

@bulrush15 commented on GitHub (Mar 19, 2026):

Can ALLM quit and trap the error more gracefully or is the timeout all we can do for this case?

I'm just brainstorming here.

<!-- gh-comment-id:4093494006 --> @bulrush15 commented on GitHub (Mar 19, 2026): Can ALLM quit and trap the error more gracefully or is the timeout all we can do for this case? I'm just brainstorming here.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Desktop
Docker
Integration Request
Integration Request
OS: Linux
OS: Mobile
OS: Windows
UI/UX
blocked
bug
bug
core-team-only
documentation
duplicate
embed-widget
enhancement
feature request
github_actions
good first issue
investigating
needs info / can't replicate
possible bug
pull-request
Mirrored from GitHub Pull Request
 question
stage: specifications
wontfix
No Label investigating possible bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#4969
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?