[PR #56] [MERGED] Blocks images in sitemaps from being parsed. #3190

Closed
opened 2026-02-22 18:33:14 -05:00 by yindo · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/Mintplex-Labs/anything-llm/pull/56
Author: @skidvis
Created: 6/14/2023
Status: Merged
Merged: 6/15/2023
Merged by: @timothycarambat

Base: masterHead: master


📝 Commits (5)

  • ffa7453 Adds ability to import sitemaps to include a website
  • e43cac5 adds example sitemap url
  • 32ab1c9 Merge branch 'master' of github.com:skidvis/anything-llm
  • ecb783d adds filter to bypass common image formats
  • 54e4a58 moves filetype ignoring to sitemap script

📊 Changes

2 files changed (+14 additions, -7 deletions)

View changed files

📝 collector/scripts/link.py (+1 -6)
📝 collector/scripts/sitemap.py (+13 -1)

📄 Description

Adds a method to filter out links with common image types.
Moves blocking pdfs and images to sitemap.py in case someone ever wants to make link.py accept pdf files. (it currently doesn't)


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/Mintplex-Labs/anything-llm/pull/56 **Author:** [@skidvis](https://github.com/skidvis) **Created:** 6/14/2023 **Status:** ✅ Merged **Merged:** 6/15/2023 **Merged by:** [@timothycarambat](https://github.com/timothycarambat) **Base:** `master` ← **Head:** `master` --- ### 📝 Commits (5) - [`ffa7453`](https://github.com/Mintplex-Labs/anything-llm/commit/ffa7453975390e7fe8744478870fa8de25b1d060) Adds ability to import sitemaps to include a website - [`e43cac5`](https://github.com/Mintplex-Labs/anything-llm/commit/e43cac51b272a999d15672ef56fe20e3a0747ec2) adds example sitemap url - [`32ab1c9`](https://github.com/Mintplex-Labs/anything-llm/commit/32ab1c99d26b887773d3ce5b126400e074dd8f9c) Merge branch 'master' of github.com:skidvis/anything-llm - [`ecb783d`](https://github.com/Mintplex-Labs/anything-llm/commit/ecb783d2943658b2b4dc0c4f5712b00768afe2e4) adds filter to bypass common image formats - [`54e4a58`](https://github.com/Mintplex-Labs/anything-llm/commit/54e4a58799d40d00e2bd35ed451c6e3aa5c4c9af) moves filetype ignoring to sitemap script ### 📊 Changes **2 files changed** (+14 additions, -7 deletions) <details> <summary>View changed files</summary> 📝 `collector/scripts/link.py` (+1 -6) 📝 `collector/scripts/sitemap.py` (+13 -1) </details> ### 📄 Description Adds a method to filter out links with common image types. Moves blocking pdfs and images to sitemap.py in case someone ever wants to make link.py accept pdf files. (it currently doesn't) --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-22 18:33:14 -05:00
yindo closed this issue 2026-02-22 18:33:14 -05:00
yindo changed title from [PR #56] [MERGED] Blocks images in sitemaps from being parsed. to [PR #56] [MERGED] Blocks images in sitemaps from being parsed. 2026-06-05 14:53:45 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#3190