[PR #4261] [MERGED] Workspace Chat with documents overhaul #4572

Closed
opened 2026-02-22 18:36:06 -05:00 by yindo · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/Mintplex-Labs/anything-llm/pull/4261
Author: @timothycarambat
Created: 8/7/2025
Status: Merged
Merged: 8/11/2025
Merged by: @timothycarambat

Base: masterHead: upload-ui-ux


📝 Commits (10+)

  • 60ad887 Create parse endpoint in collector (#4212)
  • d899eef Add parsed files table and parse server endpoints (#4222)
  • f2752f5 Merge branch 'master' into upload-ui-ux
  • f91031d merge with master
  • 1ee9750 Merge branch 'master' of github.com:Mintplex-Labs/anything-llm into upload-ui-ux
  • e2fc99e Upload UI/UX context window check + frontend alert (#4230)
  • 99744c7 dev build
  • 8e1d9b3 fix tooltip hiding during embedding overflow files
  • 4a3e2b4 prevent crash log from ERRNO on parse files
  • 412f9c7 Merge branch 'upload-ui-ux' of github.com:Mintplex-Labs/anything-llm into upload-ui-ux

📊 Changes

35 files changed (+1471 additions, -101 deletions)

View changed files

📝 .github/workflows/dev-build.yaml (+1 -1)
📝 collector/index.js (+33 -0)
📝 collector/processSingleFile/convert/asAudio.js (+1 -0)
📝 collector/processSingleFile/convert/asDocx.js (+2 -1)
📝 collector/processSingleFile/convert/asEPub.js (+2 -1)
📝 collector/processSingleFile/convert/asImage.js (+1 -0)
📝 collector/processSingleFile/convert/asMbox.js (+1 -0)
📝 collector/processSingleFile/convert/asOfficeMime.js (+1 -0)
📝 collector/processSingleFile/convert/asPDF/index.js (+1 -0)
📝 collector/processSingleFile/convert/asTxt.js (+2 -1)
📝 collector/processSingleFile/convert/asXlsx.js (+6 -2)
📝 collector/utils/files/index.js (+17 -1)
📝 frontend/src/components/WorkspaceChat/ChatContainer/ChatTooltips/index.jsx (+6 -0)
frontend/src/components/WorkspaceChat/ChatContainer/DnDWrapper/FileUploadWarningModal/index.jsx (+106 -0)
📝 frontend/src/components/WorkspaceChat/ChatContainer/DnDWrapper/index.jsx (+230 -40)
frontend/src/components/WorkspaceChat/ChatContainer/PromptInput/AttachItem/ParsedFilesMenu/index.jsx (+197 -0)
📝 frontend/src/components/WorkspaceChat/ChatContainer/PromptInput/AttachItem/index.jsx (+112 -20)
📝 frontend/src/components/WorkspaceChat/ChatContainer/PromptInput/Attachments/index.jsx (+6 -2)
📝 frontend/src/components/WorkspaceChat/index.jsx (+1 -1)
📝 frontend/src/models/workspace.js (+50 -1)

...and 15 more files

📄 Description

Pull Request Type

  • feat
  • 🐛 fix
  • ♻️ refactor
  • 💄 style
  • 🔨 chore
  • 📝 docs

Relevant Issues

resolves #3347
resolves #2981
resolves #2301
resolves #2301
resolves #3208
resolves #2533

Documentation PR: https://github.com/Mintplex-Labs/anythingllm-docs/pull/184

What is in this change?

Major overhaul of how upload/RAG works in AnythingLLM

  • All users can now drag-n-drop files into upload window

  • File will first be full text appended to workspace/thread. This upload is unique to that specific thread

  • If the file to too large, alert window will be show to:

    • Cancel (remove files)
    • Continue Anyway (keep full text, but will be truncated by pruning process to prevent chat failures)
    • Embed (admin/manager only) embed file into the workspace for all users.
  • Hovering over the paperclip icon will allow you to easily manage attached files. The tradtional file uploader will be the primary way to add a file for RAG. The default is now to attach a full file. This will completely resolve the "Why does the LLM not see the whole file" questions we get often.

  • Collector can now parse files which dumps them to a non-viewable folder in the system different from file uploads so that they are not accidentally leaked cross user.

Additional Information

  • BackgroundWorker now starts all the times. However, jobs are now marked as always or conditional
  • A BG worker cleans up the direct upload files if their reference in the system is deleted or removed.

Developer Validations

  • I ran yarn lint from the root of the repo & committed changes
  • Relevant documentation has been updated
  • I have tested my code functionality
  • Docker build succeeds locally

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/Mintplex-Labs/anything-llm/pull/4261 **Author:** [@timothycarambat](https://github.com/timothycarambat) **Created:** 8/7/2025 **Status:** ✅ Merged **Merged:** 8/11/2025 **Merged by:** [@timothycarambat](https://github.com/timothycarambat) **Base:** `master` ← **Head:** `upload-ui-ux` --- ### 📝 Commits (10+) - [`60ad887`](https://github.com/Mintplex-Labs/anything-llm/commit/60ad8873952881100bee39ca10dc0b4edc76e4b7) Create parse endpoint in collector (#4212) - [`d899eef`](https://github.com/Mintplex-Labs/anything-llm/commit/d899eefeb6cd81ec731e1a66949fa4315c860d3e) Add parsed files table and parse server endpoints (#4222) - [`f2752f5`](https://github.com/Mintplex-Labs/anything-llm/commit/f2752f5eed59cdcd84ebd5f0c9b5c196d4d90851) Merge branch 'master' into upload-ui-ux - [`f91031d`](https://github.com/Mintplex-Labs/anything-llm/commit/f91031d85ba019329b7e08a0652a77e40fc2bd3e) merge with master - [`1ee9750`](https://github.com/Mintplex-Labs/anything-llm/commit/1ee9750f9ea452a55eaa30a2e196ce5b8a1b6a6d) Merge branch 'master' of github.com:Mintplex-Labs/anything-llm into upload-ui-ux - [`e2fc99e`](https://github.com/Mintplex-Labs/anything-llm/commit/e2fc99e83976203c9cb2d013da771dd353a19d5d) Upload UI/UX context window check + frontend alert (#4230) - [`99744c7`](https://github.com/Mintplex-Labs/anything-llm/commit/99744c74cde03573eee412c28fd767ac3289afd1) dev build - [`8e1d9b3`](https://github.com/Mintplex-Labs/anything-llm/commit/8e1d9b30baf01c2fb5263e109ba0ac22caf5db55) fix tooltip hiding during embedding overflow files - [`4a3e2b4`](https://github.com/Mintplex-Labs/anything-llm/commit/4a3e2b4bf4c27ff6238dfbeb9e656d90d590ba2b) prevent crash log from ERRNO on parse files - [`412f9c7`](https://github.com/Mintplex-Labs/anything-llm/commit/412f9c73cabfa05b454e15c08b7d20e3eec06869) Merge branch 'upload-ui-ux' of github.com:Mintplex-Labs/anything-llm into upload-ui-ux ### 📊 Changes **35 files changed** (+1471 additions, -101 deletions) <details> <summary>View changed files</summary> 📝 `.github/workflows/dev-build.yaml` (+1 -1) 📝 `collector/index.js` (+33 -0) 📝 `collector/processSingleFile/convert/asAudio.js` (+1 -0) 📝 `collector/processSingleFile/convert/asDocx.js` (+2 -1) 📝 `collector/processSingleFile/convert/asEPub.js` (+2 -1) 📝 `collector/processSingleFile/convert/asImage.js` (+1 -0) 📝 `collector/processSingleFile/convert/asMbox.js` (+1 -0) 📝 `collector/processSingleFile/convert/asOfficeMime.js` (+1 -0) 📝 `collector/processSingleFile/convert/asPDF/index.js` (+1 -0) 📝 `collector/processSingleFile/convert/asTxt.js` (+2 -1) 📝 `collector/processSingleFile/convert/asXlsx.js` (+6 -2) 📝 `collector/utils/files/index.js` (+17 -1) 📝 `frontend/src/components/WorkspaceChat/ChatContainer/ChatTooltips/index.jsx` (+6 -0) ➕ `frontend/src/components/WorkspaceChat/ChatContainer/DnDWrapper/FileUploadWarningModal/index.jsx` (+106 -0) 📝 `frontend/src/components/WorkspaceChat/ChatContainer/DnDWrapper/index.jsx` (+230 -40) ➕ `frontend/src/components/WorkspaceChat/ChatContainer/PromptInput/AttachItem/ParsedFilesMenu/index.jsx` (+197 -0) 📝 `frontend/src/components/WorkspaceChat/ChatContainer/PromptInput/AttachItem/index.jsx` (+112 -20) 📝 `frontend/src/components/WorkspaceChat/ChatContainer/PromptInput/Attachments/index.jsx` (+6 -2) 📝 `frontend/src/components/WorkspaceChat/index.jsx` (+1 -1) 📝 `frontend/src/models/workspace.js` (+50 -1) _...and 15 more files_ </details> ### 📄 Description ### Pull Request Type <!-- For change type, change [ ] to [x]. --> - [x] ✨ feat - [ ] 🐛 fix - [x] ♻️ refactor - [ ] 💄 style - [ ] 🔨 chore - [x] 📝 docs ### Relevant Issues <!-- Use "resolves #xxx" to auto resolve on merge. Otherwise, please use "connect #xxx" --> resolves #3347 resolves #2981 resolves #2301 resolves #2301 resolves #3208 resolves #2533 Documentation PR: https://github.com/Mintplex-Labs/anythingllm-docs/pull/184 ### What is in this change? ### Major overhaul of how upload/RAG works in AnythingLLM - **All users** can now drag-n-drop files into upload window - File will first be _full text appended_ to workspace/thread. This upload is unique to that specific thread - If the file to too large, alert window will be show to: - Cancel (remove files) - Continue Anyway (keep full text, but will be truncated by pruning process to prevent chat failures) - Embed (admin/manager only) embed file into the workspace for all users. - Hovering over the paperclip icon will allow you to easily manage _attached_ files. The tradtional file uploader will be the primary way to add a file for RAG. The default is now to attach a full file. This will completely resolve the _"Why does the LLM not see the whole file"_ questions we get often. - Collector can now `parse` files which dumps them to a non-viewable folder in the system different from file uploads so that they are not accidentally leaked cross user. ### Additional Information - BackgroundWorker now starts all the times. However, jobs are now marked as `always` or conditional - A BG worker cleans up the direct upload files if their reference in the system is deleted or removed. <!-- Add any other context about the Pull Request here that was not captured above. --> ### Developer Validations <!-- All of the applicable items should be checked. --> - [x] I ran `yarn lint` from the root of the repo & committed changes - [x] Relevant documentation has been updated - [x] I have tested my code functionality - [x] Docker build succeeds locally --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-22 18:36:06 -05:00
yindo closed this issue 2026-02-22 18:36:06 -05:00
yindo changed title from [PR #4261] Workspace Chat with documents overhaul to [PR #4261] [MERGED] Workspace Chat with documents overhaul 2026-06-05 15:19:15 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#4572