[PR #51] [MERGED] Adds ability to import sitemaps to include a website #3185

Closed
opened 2026-02-22 18:33:13 -05:00 by yindo · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/Mintplex-Labs/anything-llm/pull/51
Author: @skidvis
Created: 6/14/2023
Status: Merged
Merged: 6/14/2023
Merged by: @timothycarambat

Base: masterHead: master


📝 Commits (2)

  • ffa7453 Adds ability to import sitemaps to include a website
  • e43cac5 adds example sitemap url

📊 Changes

3 files changed (+103 additions, -55 deletions)

View changed files

📝 collector/main.py (+7 -1)
📝 collector/scripts/link.py (+69 -54)
collector/scripts/sitemap.py (+27 -0)

📄 Description

Adds sitemap.py, a new menu link in main.py for sitemaps, and refactors link.py to reuse its link parsing in sitemap.y

Allows one to provide a link to a sitemap url as a list of links to include.


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/Mintplex-Labs/anything-llm/pull/51 **Author:** [@skidvis](https://github.com/skidvis) **Created:** 6/14/2023 **Status:** ✅ Merged **Merged:** 6/14/2023 **Merged by:** [@timothycarambat](https://github.com/timothycarambat) **Base:** `master` ← **Head:** `master` --- ### 📝 Commits (2) - [`ffa7453`](https://github.com/Mintplex-Labs/anything-llm/commit/ffa7453975390e7fe8744478870fa8de25b1d060) Adds ability to import sitemaps to include a website - [`e43cac5`](https://github.com/Mintplex-Labs/anything-llm/commit/e43cac51b272a999d15672ef56fe20e3a0747ec2) adds example sitemap url ### 📊 Changes **3 files changed** (+103 additions, -55 deletions) <details> <summary>View changed files</summary> 📝 `collector/main.py` (+7 -1) 📝 `collector/scripts/link.py` (+69 -54) ➕ `collector/scripts/sitemap.py` (+27 -0) </details> ### 📄 Description Adds sitemap.py, a new menu link in main.py for sitemaps, and refactors link.py to reuse its link parsing in sitemap.y Allows one to provide a link to a sitemap url as a list of links to include. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-22 18:33:13 -05:00
yindo closed this issue 2026-02-22 18:33:13 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#3185