[PR #3695] [MERGED] Allow custom headers in upload-link endpoint #4362

Closed
opened 2026-02-22 18:35:40 -05:00 by yindo · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/Mintplex-Labs/anything-llm/pull/3695
Author: @shatfield4
Created: 4/21/2025
Status: Merged
Merged: 4/22/2025
Merged by: @shatfield4

Base: masterHead: 3626-feat-allow-custom-headers-for-the-upload-link-endpoint


📝 Commits (5)

  • 1c425fe allow custom headers in upload-link endpoint
  • 0cfe3f9 override loader.scrape to allow for passing of headers in langchain puppeteer
  • 29bd87a lint
  • cca3641 Rename some variables
  • d7b301f update header validation for custom headers

📊 Changes

6 files changed (+125 additions, -26 deletions)

View changed files

📝 collector/index.js (+6 -2)
📝 collector/processLink/convert/generic.js (+71 -13)
📝 collector/processLink/index.js (+21 -4)
📝 server/endpoints/api/document/index.js (+14 -4)
📝 server/swagger/openapi.json (+5 -1)
📝 server/utils/collectorApi/index.js (+8 -2)

📄 Description

Pull Request Type

  • feat
  • 🐛 fix
  • ♻️ refactor
  • 💄 style
  • 🔨 chore
  • 📝 docs

Relevant Issues

resolves #3626

What is in this change?

  • Allows users calling on the /v1/document/upload-link endpoint to set (optional) custom headers that are passed to the puppeteer web scraper
  • Ensured it does not break any existing functionality in developer API or main application

Additional Information

Developer Validations

  • I ran yarn lint from the root of the repo & committed changes
  • Relevant documentation has been updated
  • I have tested my code functionality
  • Docker build succeeds locally

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/Mintplex-Labs/anything-llm/pull/3695 **Author:** [@shatfield4](https://github.com/shatfield4) **Created:** 4/21/2025 **Status:** ✅ Merged **Merged:** 4/22/2025 **Merged by:** [@shatfield4](https://github.com/shatfield4) **Base:** `master` ← **Head:** `3626-feat-allow-custom-headers-for-the-upload-link-endpoint` --- ### 📝 Commits (5) - [`1c425fe`](https://github.com/Mintplex-Labs/anything-llm/commit/1c425fe5b704faca10fd6ab2212a53dc9e67ebfd) allow custom headers in upload-link endpoint - [`0cfe3f9`](https://github.com/Mintplex-Labs/anything-llm/commit/0cfe3f9678e1be03fed0013ba394899e9db8e834) override loader.scrape to allow for passing of headers in langchain puppeteer - [`29bd87a`](https://github.com/Mintplex-Labs/anything-llm/commit/29bd87a865ac8e65e8c865ee62068df0143e9d37) lint - [`cca3641`](https://github.com/Mintplex-Labs/anything-llm/commit/cca364133356381b9f06220bf77a6581f5ba033d) Rename some variables - [`d7b301f`](https://github.com/Mintplex-Labs/anything-llm/commit/d7b301f86ce2a08040344718e0fe0c8fb01af609) update header validation for custom headers ### 📊 Changes **6 files changed** (+125 additions, -26 deletions) <details> <summary>View changed files</summary> 📝 `collector/index.js` (+6 -2) 📝 `collector/processLink/convert/generic.js` (+71 -13) 📝 `collector/processLink/index.js` (+21 -4) 📝 `server/endpoints/api/document/index.js` (+14 -4) 📝 `server/swagger/openapi.json` (+5 -1) 📝 `server/utils/collectorApi/index.js` (+8 -2) </details> ### 📄 Description ### Pull Request Type <!-- For change type, change [ ] to [x]. --> - [x] ✨ feat - [ ] 🐛 fix - [ ] ♻️ refactor - [ ] 💄 style - [ ] 🔨 chore - [ ] 📝 docs ### Relevant Issues <!-- Use "resolves #xxx" to auto resolve on merge. Otherwise, please use "connect #xxx" --> resolves #3626 ### What is in this change? <!-- Describe the changes in this PR that are impactful to the repo. --> - Allows users calling on the `/v1/document/upload-link` endpoint to set (optional) custom headers that are passed to the puppeteer web scraper - Ensured it does not break any existing functionality in developer API or main application ### Additional Information <!-- Add any other context about the Pull Request here that was not captured above. --> ### Developer Validations <!-- All of the applicable items should be checked. --> - [x] I ran `yarn lint` from the root of the repo & committed changes - [x] Relevant documentation has been updated - [x] I have tested my code functionality - [x] Docker build succeeds locally --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-22 18:35:40 -05:00
yindo closed this issue 2026-02-22 18:35:40 -05:00
yindo changed title from [PR #3695] Allow custom headers in upload-link endpoint to [PR #3695] [MERGED] Allow custom headers in upload-link endpoint 2026-06-05 15:18:11 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#4362