[PR #4212] [MERGED] Create parse endpoint in collector #4559

Closed
opened 2026-02-22 18:36:04 -05:00 by yindo · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/Mintplex-Labs/anything-llm/pull/4212
Author: @shatfield4
Created: 7/29/2025
Status: Merged
Merged: 7/29/2025
Merged by: @shatfield4

Base: upload-ui-uxHead: upload-ui-ux-collector-parse-endpoint


📝 Commits (6)

  • 428aa85 create parse endpoint in collector
  • eec1c88 revert cleanup temp util call
  • 1a6c522 lint
  • 35013b3 remove unused cleanupTempDocuments function
  • 1540bba revert slug change
  • 8addfab merge with master for config changes

📊 Changes

11 files changed (+67 additions, -6 deletions)

View changed files

📝 collector/index.js (+33 -0)
📝 collector/processSingleFile/convert/asAudio.js (+1 -0)
📝 collector/processSingleFile/convert/asDocx.js (+2 -1)
📝 collector/processSingleFile/convert/asEPub.js (+2 -1)
📝 collector/processSingleFile/convert/asImage.js (+1 -0)
📝 collector/processSingleFile/convert/asMbox.js (+1 -0)
📝 collector/processSingleFile/convert/asOfficeMime.js (+1 -0)
📝 collector/processSingleFile/convert/asPDF/index.js (+1 -0)
📝 collector/processSingleFile/convert/asTxt.js (+2 -1)
📝 collector/processSingleFile/convert/asXlsx.js (+6 -2)
📝 collector/utils/files/index.js (+17 -1)

📄 Description

Pull Request Type

  • feat
  • 🐛 fix
  • ♻️ refactor
  • 💄 style
  • 🔨 chore
  • 📝 docs

Relevant Issues

resolves #xxx

What is in this change?

  • Adds new /parse endpoint to collector setting up collector backend to process and store parsed files temporarily
  • Update all converter functions to pass options object for handling temp parsing
  • Modify writeToServerDocuments to handle temp storage

Additional Information

Developer Validations

  • I ran yarn lint from the root of the repo & committed changes
  • Relevant documentation has been updated
  • I have tested my code functionality
  • Docker build succeeds locally

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/Mintplex-Labs/anything-llm/pull/4212 **Author:** [@shatfield4](https://github.com/shatfield4) **Created:** 7/29/2025 **Status:** ✅ Merged **Merged:** 7/29/2025 **Merged by:** [@shatfield4](https://github.com/shatfield4) **Base:** `upload-ui-ux` ← **Head:** `upload-ui-ux-collector-parse-endpoint` --- ### 📝 Commits (6) - [`428aa85`](https://github.com/Mintplex-Labs/anything-llm/commit/428aa855a40d813236915ba7a5899acabe5f33a1) create parse endpoint in collector - [`eec1c88`](https://github.com/Mintplex-Labs/anything-llm/commit/eec1c88fe44faeb33d0fdd383852a4d8b65c65af) revert cleanup temp util call - [`1a6c522`](https://github.com/Mintplex-Labs/anything-llm/commit/1a6c522cd31a71e565aa122e141923ceaee3eca0) lint - [`35013b3`](https://github.com/Mintplex-Labs/anything-llm/commit/35013b38072c4bfed58988006e0023786e401dae) remove unused cleanupTempDocuments function - [`1540bba`](https://github.com/Mintplex-Labs/anything-llm/commit/1540bba612ffefdcc6de8a7f51df60a8bd1f9ce3) revert slug change - [`8addfab`](https://github.com/Mintplex-Labs/anything-llm/commit/8addfab1e6c9f28f9a79e757ca6dae0a2583111d) merge with master for config changes ### 📊 Changes **11 files changed** (+67 additions, -6 deletions) <details> <summary>View changed files</summary> 📝 `collector/index.js` (+33 -0) 📝 `collector/processSingleFile/convert/asAudio.js` (+1 -0) 📝 `collector/processSingleFile/convert/asDocx.js` (+2 -1) 📝 `collector/processSingleFile/convert/asEPub.js` (+2 -1) 📝 `collector/processSingleFile/convert/asImage.js` (+1 -0) 📝 `collector/processSingleFile/convert/asMbox.js` (+1 -0) 📝 `collector/processSingleFile/convert/asOfficeMime.js` (+1 -0) 📝 `collector/processSingleFile/convert/asPDF/index.js` (+1 -0) 📝 `collector/processSingleFile/convert/asTxt.js` (+2 -1) 📝 `collector/processSingleFile/convert/asXlsx.js` (+6 -2) 📝 `collector/utils/files/index.js` (+17 -1) </details> ### 📄 Description ### Pull Request Type <!-- For change type, change [ ] to [x]. --> - [x] ✨ feat - [ ] 🐛 fix - [ ] ♻️ refactor - [ ] 💄 style - [ ] 🔨 chore - [ ] 📝 docs ### Relevant Issues <!-- Use "resolves #xxx" to auto resolve on merge. Otherwise, please use "connect #xxx" --> resolves #xxx ### What is in this change? <!-- Describe the changes in this PR that are impactful to the repo. --> - Adds new `/parse` endpoint to collector setting up collector backend to process and store parsed files temporarily - Update all converter functions to pass `options` object for handling temp parsing - Modify `writeToServerDocuments` to handle temp storage ### Additional Information <!-- Add any other context about the Pull Request here that was not captured above. --> ### Developer Validations <!-- All of the applicable items should be checked. --> - [x] I ran `yarn lint` from the root of the repo & committed changes - [x] Relevant documentation has been updated - [x] I have tested my code functionality - [x] Docker build succeeds locally --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-22 18:36:04 -05:00
yindo closed this issue 2026-02-22 18:36:04 -05:00
yindo changed title from [PR #4212] Create parse endpoint in collector to [PR #4212] [MERGED] Create parse endpoint in collector 2026-06-05 15:19:10 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#4559