Mintplex-Labs/anything-llm
1
0
Fork 0
mirror of https://github.com/Mintplex-Labs/anything-llm.git synced 2026-07-19 14:13:35 -04:00
Code Issues 328 Packages Projects Releases 10 Wiki Activity

[PR #1719] [MERGED] [BETA] Live document sync #3755

New Issue
Closed
opened 2026-02-22 18:34:26 -05:00 by yindo · 0 comments
yindo commented 2026-02-22 18:34:26 -05:00
Owner
Copy Link
Copy Source

📋 Pull Request Information

Original PR: https://github.com/Mintplex-Labs/anything-llm/pull/1719
Author: @timothycarambat
Created: 6/18/2024
Status: ✅ Merged
Merged: 6/21/2024
Merged by: @timothycarambat

Base: master ← Head: beta/live-document-sync

📝 Commits (10+)

  • 54a681d wip bg workers for live document sync
  • 2993e3c Add ability to re-embed specific documents across many workspaces via background queue
  • fd98720 create frontend views and paths
  • 01517b6 update migration to delete runs on removal of watched document
  • d5e0304 Add watch support to YouTube transcripts (#1716)
  • 1ebb481 sync with master
  • cb161aa create tmp workflow modifications for beta image
  • 7285ee8 create tmp workflow modifications for beta image
  • a3c5cac create tmp workflow modifications for beta image
  • 25f4738 dual build

📊 Changes

58 files changed (+2887 additions, -306 deletions)

View changed files

📝 .vscode/settings.json (+1 -0)
📝 collector/extensions/index.js (+31 -7)
➕ collector/extensions/resync/index.js (+113 -0)
➕ collector/middleware/setDataSigner.js (+41 -0)
➕ collector/utils/EncryptionWorker/index.js (+77 -0)
📝 collector/utils/comKey/index.js (+9 -0)
📝 collector/utils/extensions/Confluence/index.js (+113 -3)
📝 collector/utils/extensions/GithubRepo/RepoLoader/index.js (+30 -0)
📝 collector/utils/extensions/GithubRepo/index.js (+78 -3)
📝 collector/utils/extensions/YoutubeTranscript/index.js (+31 -3)
📝 docker/.env.example (+2 -0)
📝 frontend/package.json (+1 -0)
📝 frontend/src/App.jsx (+18 -1)
📝 frontend/src/components/Modals/ManageWorkspace/Documents/Directory/utils.js (+1 -1)
📝 frontend/src/components/Modals/ManageWorkspace/Documents/WorkspaceDirectory/WorkspaceFileRow/index.jsx (+80 -2)
📝 frontend/src/components/Modals/ManageWorkspace/Documents/WorkspaceDirectory/index.jsx (+76 -2)
📝 frontend/src/components/SettingsSidebar/index.jsx (+60 -0)
➕ frontend/src/models/experimental/liveSync.js (+59 -0)
📝 frontend/src/models/system.js (+4 -0)
➕ frontend/src/pages/Admin/ExperimentalFeatures/Features/LiveSync/manage/DocumentSyncQueueRow/index.jsx (+44 -0)

...and 38 more files

📄 Description

Pull Request Type

  • ✨ feat
  • 🐛 fix
  • ♻️ refactor
  • 💄 style
  • 🔨 chore
  • 📝 docs

Relevant Issues

resolves #1129

Docs: https://github.com/Mintplex-Labs/anythingllm-docs/pull/49

What is in this change?

  • Background cron system that runs automatically
  • Opt-in feature flag system
  • UI for Experimental feature flag enabled
  • UI for liveDocumentSync
  • Alert models and ToS agreement for FeatureFlags
  • Sync websites,YouTube, & Confluence data sources

Additional Information

Developer Validations

  • I ran yarn lint from the root of the repo & committed changes
  • Relevant documentation has been updated
  • I have tested my code functionality
  • Docker build succeeds locally

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/Mintplex-Labs/anything-llm/pull/1719 **Author:** [@timothycarambat](https://github.com/timothycarambat) **Created:** 6/18/2024 **Status:** ✅ Merged **Merged:** 6/21/2024 **Merged by:** [@timothycarambat](https://github.com/timothycarambat) **Base:** `master` ← **Head:** `beta/live-document-sync` --- ### 📝 Commits (10+) - [`54a681d`](https://github.com/Mintplex-Labs/anything-llm/commit/54a681d7c1cafbed45c5e60168f5fddac720825e) wip bg workers for live document sync - [`2993e3c`](https://github.com/Mintplex-Labs/anything-llm/commit/2993e3c30dcd3cba5b1d43ad2594afdb02f8dbe6) Add ability to re-embed specific documents across many workspaces via background queue - [`fd98720`](https://github.com/Mintplex-Labs/anything-llm/commit/fd98720109bcfa72c578c251943c68e00701eb4b) create frontend views and paths - [`01517b6`](https://github.com/Mintplex-Labs/anything-llm/commit/01517b6c7453f38ebf46a63d9b5af9e537fc2ade) update migration to delete runs on removal of watched document - [`d5e0304`](https://github.com/Mintplex-Labs/anything-llm/commit/d5e0304615ce0dc4ebb226a6a83ec3e849cbfe74) Add watch support to YouTube transcripts (#1716) - [`1ebb481`](https://github.com/Mintplex-Labs/anything-llm/commit/1ebb481fa8a5552b17766e18d49fc845282c4117) sync with master - [`cb161aa`](https://github.com/Mintplex-Labs/anything-llm/commit/cb161aa65ca72734ab35a4235cd9e2b1270167c8) create tmp workflow modifications for beta image - [`7285ee8`](https://github.com/Mintplex-Labs/anything-llm/commit/7285ee844ccc0dc4c129bff2c7a6a5aef66a53e8) create tmp workflow modifications for beta image - [`a3c5cac`](https://github.com/Mintplex-Labs/anything-llm/commit/a3c5cacc5950b4ab504678564fed7e13abf25b22) create tmp workflow modifications for beta image - [`25f4738`](https://github.com/Mintplex-Labs/anything-llm/commit/25f4738a782a2b5a6f4fe575f5be7e6814c7d3f9) dual build ### 📊 Changes **58 files changed** (+2887 additions, -306 deletions) <details> <summary>View changed files</summary> 📝 `.vscode/settings.json` (+1 -0) 📝 `collector/extensions/index.js` (+31 -7) ➕ `collector/extensions/resync/index.js` (+113 -0) ➕ `collector/middleware/setDataSigner.js` (+41 -0) ➕ `collector/utils/EncryptionWorker/index.js` (+77 -0) 📝 `collector/utils/comKey/index.js` (+9 -0) 📝 `collector/utils/extensions/Confluence/index.js` (+113 -3) 📝 `collector/utils/extensions/GithubRepo/RepoLoader/index.js` (+30 -0) 📝 `collector/utils/extensions/GithubRepo/index.js` (+78 -3) 📝 `collector/utils/extensions/YoutubeTranscript/index.js` (+31 -3) 📝 `docker/.env.example` (+2 -0) 📝 `frontend/package.json` (+1 -0) 📝 `frontend/src/App.jsx` (+18 -1) 📝 `frontend/src/components/Modals/ManageWorkspace/Documents/Directory/utils.js` (+1 -1) 📝 `frontend/src/components/Modals/ManageWorkspace/Documents/WorkspaceDirectory/WorkspaceFileRow/index.jsx` (+80 -2) 📝 `frontend/src/components/Modals/ManageWorkspace/Documents/WorkspaceDirectory/index.jsx` (+76 -2) 📝 `frontend/src/components/SettingsSidebar/index.jsx` (+60 -0) ➕ `frontend/src/models/experimental/liveSync.js` (+59 -0) 📝 `frontend/src/models/system.js` (+4 -0) ➕ `frontend/src/pages/Admin/ExperimentalFeatures/Features/LiveSync/manage/DocumentSyncQueueRow/index.jsx` (+44 -0) _...and 38 more files_ </details> ### 📄 Description ### Pull Request Type <!-- For change type, change [ ] to [x]. --> - [x] ✨ feat - [ ] 🐛 fix - [ ] ♻️ refactor - [ ] 💄 style - [ ] 🔨 chore - [ ] 📝 docs ### Relevant Issues <!-- Use "resolves #xxx" to auto resolve on merge. Otherwise, please use "connect #xxx" --> resolves #1129 Docs: https://github.com/Mintplex-Labs/anythingllm-docs/pull/49 ### What is in this change? - Background cron system that runs automatically - Opt-in feature flag system - UI for Experimental feature flag enabled - UI for liveDocumentSync - Alert models and ToS agreement for FeatureFlags - Sync websites,YouTube, & Confluence data sources <!-- Describe the changes in this PR that are impactful to the repo. --> ### Additional Information <!-- Add any other context about the Pull Request here that was not captured above. --> ### Developer Validations <!-- All of the applicable items should be checked. --> - [x] I ran `yarn lint` from the root of the repo & committed changes - [x] Relevant documentation has been updated - [x] I have tested my code functionality - [x] Docker build succeeds locally --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-22 18:34:26 -05:00
yindo closed this issue 2026-02-22 18:34:26 -05:00
yindo changed title from [PR #1719] [BETA] Live document sync to [PR #1719] [MERGED] [BETA] Live document sync 2026-06-05 15:15:03 -04:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Desktop
Docker
Integration Request
Integration Request
OS: Linux
OS: Mobile
OS: Windows
UI/UX
blocked
bug
bug
core-team-only
documentation
duplicate
embed-widget
enhancement
feature request
github_actions
good first issue
investigating
needs info / can't replicate
possible bug
pull-request
Mirrored from GitHub Pull Request
 question
stage: specifications
wontfix
No Label pull-request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#3755
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?