Mintplex-Labs/anything-llm
1
0
Fork 0
mirror of https://github.com/Mintplex-Labs/anything-llm.git synced 2026-07-19 22:23:50 -04:00
Code Issues 328 Packages Projects Releases 10 Wiki Activity

[PR #375] [MERGED] Adding url uploads to document picker #3321

New Issue
Closed
opened 2026-02-22 18:33:33 -05:00 by yindo · 0 comments
yindo commented 2026-02-22 18:33:33 -05:00
Owner
Copy Link
Copy Source

📋 Pull Request Information

Original PR: https://github.com/Mintplex-Labs/anything-llm/pull/375
Author: @shatfield4
Created: 11/14/2023
Status: ✅ Merged
Merged: 11/16/2023
Merged by: @timothycarambat

Base: master ← Head: 363-url-scraping-for-document-sourcing

📝 Commits (8)

  • f899c1b WIP adding url uploads to document picker
  • b7bd21d Merge branch 'master' into 363-url-scraping-for-document-sourcing
  • 92a0d19 fix manual script for uploading url to custom-documents
  • 4cd532e fix metadata for url scraping
  • 8576446 wip url parsing
  • 6f793a6 merge with master
  • b68ea53 update how async link scraping works
  • 93df633 docker-compose defaults added

📊 Changes

12 files changed (+227 additions, -28 deletions)

View changed files

📝 .dockerignore (+1 -0)
📝 collector/api.py (+10 -0)
📝 collector/requirements.txt (+1 -0)
📝 collector/scripts/link.py (+69 -18)
📝 collector/scripts/link_utils.py (+27 -4)
📝 docker/docker-compose.yml (+3 -3)
📝 frontend/src/components/Modals/MangeWorkspace/Documents/Directory/index.jsx (+2 -0)
📝 frontend/src/components/Modals/MangeWorkspace/Documents/UploadFile/index.jsx (+49 -1)
📝 frontend/src/models/workspace.js (+10 -0)
📝 frontend/src/utils/directories.js (+1 -2)
📝 server/endpoints/workspaces.js (+33 -0)
📝 server/utils/files/documentProcessor.js (+21 -0)

📄 Description

resolves #363

Adds an input for users to put links to scrape and insert them into their documents

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/Mintplex-Labs/anything-llm/pull/375 **Author:** [@shatfield4](https://github.com/shatfield4) **Created:** 11/14/2023 **Status:** ✅ Merged **Merged:** 11/16/2023 **Merged by:** [@timothycarambat](https://github.com/timothycarambat) **Base:** `master` ← **Head:** `363-url-scraping-for-document-sourcing` --- ### 📝 Commits (8) - [`f899c1b`](https://github.com/Mintplex-Labs/anything-llm/commit/f899c1bf5670cdba17f7bff51f1183fce3c77d34) WIP adding url uploads to document picker - [`b7bd21d`](https://github.com/Mintplex-Labs/anything-llm/commit/b7bd21d07ec4eb908b8e7b6b92969c0421e8d8f7) Merge branch 'master' into 363-url-scraping-for-document-sourcing - [`92a0d19`](https://github.com/Mintplex-Labs/anything-llm/commit/92a0d19fac4cb1aab05cdd2673ab69865aec20fe) fix manual script for uploading url to custom-documents - [`4cd532e`](https://github.com/Mintplex-Labs/anything-llm/commit/4cd532e81e018c0211b4c39283842bb238ee184e) fix metadata for url scraping - [`8576446`](https://github.com/Mintplex-Labs/anything-llm/commit/85764462fdd3235ccadedf71cadfc353e3abf349) wip url parsing - [`6f793a6`](https://github.com/Mintplex-Labs/anything-llm/commit/6f793a6d20ddf2f413a5972fefc6a2172d4aa68b) merge with master - [`b68ea53`](https://github.com/Mintplex-Labs/anything-llm/commit/b68ea534db3cee25922412b26134f51a633cfe7b) update how async link scraping works - [`93df633`](https://github.com/Mintplex-Labs/anything-llm/commit/93df6333739db86133d07a35833fdfa1ac91c095) docker-compose defaults added ### 📊 Changes **12 files changed** (+227 additions, -28 deletions) <details> <summary>View changed files</summary> 📝 `.dockerignore` (+1 -0) 📝 `collector/api.py` (+10 -0) 📝 `collector/requirements.txt` (+1 -0) 📝 `collector/scripts/link.py` (+69 -18) 📝 `collector/scripts/link_utils.py` (+27 -4) 📝 `docker/docker-compose.yml` (+3 -3) 📝 `frontend/src/components/Modals/MangeWorkspace/Documents/Directory/index.jsx` (+2 -0) 📝 `frontend/src/components/Modals/MangeWorkspace/Documents/UploadFile/index.jsx` (+49 -1) 📝 `frontend/src/models/workspace.js` (+10 -0) 📝 `frontend/src/utils/directories.js` (+1 -2) 📝 `server/endpoints/workspaces.js` (+33 -0) 📝 `server/utils/files/documentProcessor.js` (+21 -0) </details> ### 📄 Description resolves #363 Adds an input for users to put links to scrape and insert them into their documents --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-22 18:33:33 -05:00
yindo closed this issue 2026-02-22 18:33:33 -05:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Desktop
Docker
Integration Request
Integration Request
OS: Linux
OS: Mobile
OS: Windows
UI/UX
blocked
bug
bug
core-team-only
documentation
duplicate
embed-widget
enhancement
feature request
github_actions
good first issue
investigating
needs info / can't replicate
possible bug
pull-request
Mirrored from GitHub Pull Request
 question
stage: specifications
wontfix
No Label pull-request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#3321
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?