[GH-ISSUE #2478] [FEAT]: bulk link scraper realtime log #1609

Closed
opened 2026-02-22 18:25:39 -05:00 by yindo · 2 comments
Owner

Originally created by @jasonmhead on GitHub (Oct 15, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2478

What would you like to see?

I would be useful to have a bulk link scraper realtime log so you can see that the scraping is working, and progress,
and especially the error when the fetch fails.

The first process can take a while, then you see fetch failed with no other details.

Originally created by @jasonmhead on GitHub (Oct 15, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2478 ### What would you like to see? I would be useful to have a bulk link scraper realtime log so you can see that the scraping is working, and progress, and especially the error when the fetch fails. The first process can take a while, then you see fetch failed with no other details.
yindo added the enhancementfeature request labels 2026-02-22 18:25:39 -05:00
yindo closed this issue 2026-02-22 18:25:39 -05:00
Author
Owner

@timothycarambat commented on GitHub (Oct 15, 2024):

Agreed, all the scrapers need reporting back to UI, as well as embedding.
This particular feature is tracked in https://github.com/Mintplex-Labs/anything-llm/issues/1570

@timothycarambat commented on GitHub (Oct 15, 2024): Agreed, all the scrapers need reporting back to UI, as well as embedding. This particular feature is tracked in https://github.com/Mintplex-Labs/anything-llm/issues/1570
Author
Owner

@timothycarambat commented on GitHub (Oct 15, 2024):

There is a comment at the end of the above link that shows how to tail said log from backend directly

@timothycarambat commented on GitHub (Oct 15, 2024): There is a comment at the end of the above link that shows how to tail said log from backend directly
yindo changed title from [FEAT]: bulk link scraper realtime log to [GH-ISSUE #2478] [FEAT]: bulk link scraper realtime log 2026-06-05 14:41:43 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#1609