[PR #442] [MERGED] Document Processor v2 #3355

Closed
opened 2026-02-22 18:33:37 -05:00 by yindo · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/Mintplex-Labs/anything-llm/pull/442
Author: @timothycarambat
Created: 12/13/2023
Status: Merged
Merged: 12/14/2023
Merged by: @timothycarambat

Base: masterHead: collector-refactor


📝 Commits (10+)

  • 844601b wip: init refactor of document processor to JS
  • 73feffc add NodeJs PDF support
  • b5d9538 wip: partity with python processor
  • d2b238c fix: forgot files
  • 433bb07 Remove python scripts totally
  • fb12c13 wip:update docker to boot new collector
  • c1c2cc5 Merge branch 'master' of github.com:Mintplex-Labs/anything-llm into collector-refactor
  • a05c498 add package.json support
  • fc59ca5 update dockerfile for new build
  • ef3dc52 update gitignore and linting

📊 Changes

69 files changed (+3682 additions, -1925 deletions)

View changed files

📝 README.md (+3 -9)
📝 cloud-deployments/aws/cloudformation/DEPLOY.md (+2 -3)
📝 cloud-deployments/aws/cloudformation/cloudformation_create_anythingllm.json (+1 -1)
📝 cloud-deployments/digitalocean/terraform/DEPLOY.md (+2 -6)
📝 cloud-deployments/digitalocean/terraform/user_data.tp1 (+1 -1)
📝 cloud-deployments/gcp/deployment/DEPLOY.md (+4 -11)
📝 cloud-deployments/gcp/deployment/gcp_deploy_anything_llm.yaml (+1 -1)
cloud-deployments/gcp/deployment/generate.mjs (+0 -61)
collector/.env.example (+0 -1)
📝 collector/.gitignore (+4 -6)
collector/.nvmrc (+1 -0)
collector/README.md (+0 -62)
collector/api.py (+0 -32)
📝 collector/hotdir/__HOTDIR__.md (+1 -15)
collector/index.js (+78 -0)
collector/main.py (+0 -84)
collector/nodemon.json (+3 -0)
collector/package.json (+42 -0)
collector/processLink/convert/generic.js (+72 -0)
collector/processLink/index.js (+11 -0)

...and 49 more files

📄 Description

Migrate away from Python document processor and reimplement all supported files in NodeJS


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/Mintplex-Labs/anything-llm/pull/442 **Author:** [@timothycarambat](https://github.com/timothycarambat) **Created:** 12/13/2023 **Status:** ✅ Merged **Merged:** 12/14/2023 **Merged by:** [@timothycarambat](https://github.com/timothycarambat) **Base:** `master` ← **Head:** `collector-refactor` --- ### 📝 Commits (10+) - [`844601b`](https://github.com/Mintplex-Labs/anything-llm/commit/844601bfc8f6b6cb458690d3f9954559d7656107) wip: init refactor of document processor to JS - [`73feffc`](https://github.com/Mintplex-Labs/anything-llm/commit/73feffc1701161f9b3fd479cd2dd85247bfdb38b) add NodeJs PDF support - [`b5d9538`](https://github.com/Mintplex-Labs/anything-llm/commit/b5d953821c497bbda56f80fd13550ffb00fb251e) wip: partity with python processor - [`d2b238c`](https://github.com/Mintplex-Labs/anything-llm/commit/d2b238ccff6faf4c1c5e6c2096f6227c55b9278a) fix: forgot files - [`433bb07`](https://github.com/Mintplex-Labs/anything-llm/commit/433bb07a7f8755dbb5abc87ab616f07c69cdd315) Remove python scripts totally - [`fb12c13`](https://github.com/Mintplex-Labs/anything-llm/commit/fb12c13ff76a96ea6017656e4c45a42d19df2c3d) wip:update docker to boot new collector - [`c1c2cc5`](https://github.com/Mintplex-Labs/anything-llm/commit/c1c2cc5aa1eb1e45a4d9e2cb6c9d1bbcd8d134ed) Merge branch 'master' of github.com:Mintplex-Labs/anything-llm into collector-refactor - [`a05c498`](https://github.com/Mintplex-Labs/anything-llm/commit/a05c498ea517d85ff66ed390461b52f6d5c1c5ed) add package.json support - [`fc59ca5`](https://github.com/Mintplex-Labs/anything-llm/commit/fc59ca558e08e65fa0ce3f64619b1983749c7925) update dockerfile for new build - [`ef3dc52`](https://github.com/Mintplex-Labs/anything-llm/commit/ef3dc520527263c5da162e431a06cdc8557826a1) update gitignore and linting ### 📊 Changes **69 files changed** (+3682 additions, -1925 deletions) <details> <summary>View changed files</summary> 📝 `README.md` (+3 -9) 📝 `cloud-deployments/aws/cloudformation/DEPLOY.md` (+2 -3) 📝 `cloud-deployments/aws/cloudformation/cloudformation_create_anythingllm.json` (+1 -1) 📝 `cloud-deployments/digitalocean/terraform/DEPLOY.md` (+2 -6) 📝 `cloud-deployments/digitalocean/terraform/user_data.tp1` (+1 -1) 📝 `cloud-deployments/gcp/deployment/DEPLOY.md` (+4 -11) 📝 `cloud-deployments/gcp/deployment/gcp_deploy_anything_llm.yaml` (+1 -1) ➖ `cloud-deployments/gcp/deployment/generate.mjs` (+0 -61) ➖ `collector/.env.example` (+0 -1) 📝 `collector/.gitignore` (+4 -6) ➕ `collector/.nvmrc` (+1 -0) ➖ `collector/README.md` (+0 -62) ➖ `collector/api.py` (+0 -32) 📝 `collector/hotdir/__HOTDIR__.md` (+1 -15) ➕ `collector/index.js` (+78 -0) ➖ `collector/main.py` (+0 -84) ➕ `collector/nodemon.json` (+3 -0) ➕ `collector/package.json` (+42 -0) ➕ `collector/processLink/convert/generic.js` (+72 -0) ➕ `collector/processLink/index.js` (+11 -0) _...and 49 more files_ </details> ### 📄 Description Migrate away from Python document processor and reimplement all supported files in NodeJS --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-22 18:33:37 -05:00
yindo closed this issue 2026-02-22 18:33:37 -05:00
yindo changed title from [PR #442] Document Processor v2 to [PR #442] [MERGED] Document Processor v2 2026-06-05 15:12:59 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#3355