[PR #1667] [CLOSED] Automatic live document sync #3737

Closed
opened 2026-02-22 18:34:23 -05:00 by yindo · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/Mintplex-Labs/anything-llm/pull/1667
Author: @timothycarambat
Created: 6/12/2024
Status: Closed

Base: masterHead: live-reload-websites


📝 Commits (6)

  • 54a681d wip bg workers for live document sync
  • 2993e3c Add ability to re-embed specific documents across many workspaces via background queue
  • fd98720 create frontend views and paths
  • 01517b6 update migration to delete runs on removal of watched document
  • d5e0304 Add watch support to YouTube transcripts (#1716)
  • 1ebb481 sync with master

📊 Changes

45 files changed (+2291 additions, -295 deletions)

View changed files

📝 .vscode/settings.json (+1 -0)
📝 collector/extensions/index.js (+23 -2)
collector/extensions/resync/index.js (+72 -0)
📝 collector/utils/extensions/Confluence/index.js (+81 -2)
📝 collector/utils/extensions/YoutubeTranscript/index.js (+31 -3)
📝 frontend/package.json (+1 -0)
📝 frontend/src/App.jsx (+17 -0)
📝 frontend/src/components/Modals/ManageWorkspace/Documents/Directory/utils.js (+1 -1)
📝 frontend/src/components/Modals/ManageWorkspace/Documents/WorkspaceDirectory/WorkspaceFileRow/index.jsx (+80 -2)
📝 frontend/src/components/Modals/ManageWorkspace/Documents/WorkspaceDirectory/index.jsx (+68 -2)
📝 frontend/src/components/SettingsSidebar/index.jsx (+9 -0)
frontend/src/models/experimental/liveSync.js (+59 -0)
📝 frontend/src/models/system.js (+4 -0)
frontend/src/pages/Admin/ExperimentalFeatures/Features/LiveSync/manage/DocumentSyncQueueRow/index.jsx (+44 -0)
frontend/src/pages/Admin/ExperimentalFeatures/Features/LiveSync/manage/index.jsx (+97 -0)
frontend/src/pages/Admin/ExperimentalFeatures/Features/LiveSync/toggle.jsx (+87 -0)
frontend/src/pages/Admin/ExperimentalFeatures/index.jsx (+186 -0)
📝 frontend/src/utils/constants.js (+1 -0)
📝 frontend/src/utils/paths.js (+8 -0)
📝 frontend/yarn.lock (+5 -0)

...and 25 more files

📄 Description

Pull Request Type

  • feat
  • 🐛 fix
  • ♻️ refactor
  • 💄 style
  • 🔨 chore
  • 📝 docs

Relevant Issues

resolves #xxx

What is in this change?

  • Background cron system that runs automatically
  • Opt-in feature flag system
  • UI for Experimental feature flag enabled
  • UI for liveDocumentSync
  • Alert models and ToS agreement for FeatureFlags
  • Sync websites,YouTube, & Confluence data sources

Additional Information

Developer Validations

  • I ran yarn lint from the root of the repo & committed changes
  • Relevant documentation has been updated
  • I have tested my code functionality
  • Docker build succeeds locally

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/Mintplex-Labs/anything-llm/pull/1667 **Author:** [@timothycarambat](https://github.com/timothycarambat) **Created:** 6/12/2024 **Status:** ❌ Closed **Base:** `master` ← **Head:** `live-reload-websites` --- ### 📝 Commits (6) - [`54a681d`](https://github.com/Mintplex-Labs/anything-llm/commit/54a681d7c1cafbed45c5e60168f5fddac720825e) wip bg workers for live document sync - [`2993e3c`](https://github.com/Mintplex-Labs/anything-llm/commit/2993e3c30dcd3cba5b1d43ad2594afdb02f8dbe6) Add ability to re-embed specific documents across many workspaces via background queue - [`fd98720`](https://github.com/Mintplex-Labs/anything-llm/commit/fd98720109bcfa72c578c251943c68e00701eb4b) create frontend views and paths - [`01517b6`](https://github.com/Mintplex-Labs/anything-llm/commit/01517b6c7453f38ebf46a63d9b5af9e537fc2ade) update migration to delete runs on removal of watched document - [`d5e0304`](https://github.com/Mintplex-Labs/anything-llm/commit/d5e0304615ce0dc4ebb226a6a83ec3e849cbfe74) Add watch support to YouTube transcripts (#1716) - [`1ebb481`](https://github.com/Mintplex-Labs/anything-llm/commit/1ebb481fa8a5552b17766e18d49fc845282c4117) sync with master ### 📊 Changes **45 files changed** (+2291 additions, -295 deletions) <details> <summary>View changed files</summary> 📝 `.vscode/settings.json` (+1 -0) 📝 `collector/extensions/index.js` (+23 -2) ➕ `collector/extensions/resync/index.js` (+72 -0) 📝 `collector/utils/extensions/Confluence/index.js` (+81 -2) 📝 `collector/utils/extensions/YoutubeTranscript/index.js` (+31 -3) 📝 `frontend/package.json` (+1 -0) 📝 `frontend/src/App.jsx` (+17 -0) 📝 `frontend/src/components/Modals/ManageWorkspace/Documents/Directory/utils.js` (+1 -1) 📝 `frontend/src/components/Modals/ManageWorkspace/Documents/WorkspaceDirectory/WorkspaceFileRow/index.jsx` (+80 -2) 📝 `frontend/src/components/Modals/ManageWorkspace/Documents/WorkspaceDirectory/index.jsx` (+68 -2) 📝 `frontend/src/components/SettingsSidebar/index.jsx` (+9 -0) ➕ `frontend/src/models/experimental/liveSync.js` (+59 -0) 📝 `frontend/src/models/system.js` (+4 -0) ➕ `frontend/src/pages/Admin/ExperimentalFeatures/Features/LiveSync/manage/DocumentSyncQueueRow/index.jsx` (+44 -0) ➕ `frontend/src/pages/Admin/ExperimentalFeatures/Features/LiveSync/manage/index.jsx` (+97 -0) ➕ `frontend/src/pages/Admin/ExperimentalFeatures/Features/LiveSync/toggle.jsx` (+87 -0) ➕ `frontend/src/pages/Admin/ExperimentalFeatures/index.jsx` (+186 -0) 📝 `frontend/src/utils/constants.js` (+1 -0) 📝 `frontend/src/utils/paths.js` (+8 -0) 📝 `frontend/yarn.lock` (+5 -0) _...and 25 more files_ </details> ### 📄 Description ### Pull Request Type <!-- For change type, change [ ] to [x]. --> - [ ] ✨ feat - [ ] 🐛 fix - [ ] ♻️ refactor - [ ] 💄 style - [ ] 🔨 chore - [ ] 📝 docs ### Relevant Issues <!-- Use "resolves #xxx" to auto resolve on merge. Otherwise, please use "connect #xxx" --> resolves #xxx ### What is in this change? - Background cron system that runs automatically - Opt-in feature flag system - UI for Experimental feature flag enabled - UI for liveDocumentSync - Alert models and ToS agreement for FeatureFlags - Sync websites,YouTube, & Confluence data sources <!-- Describe the changes in this PR that are impactful to the repo. --> ### Additional Information <!-- Add any other context about the Pull Request here that was not captured above. --> ### Developer Validations <!-- All of the applicable items should be checked. --> - [ ] I ran `yarn lint` from the root of the repo & committed changes - [ ] Relevant documentation has been updated - [ ] I have tested my code functionality - [ ] Docker build succeeds locally --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-22 18:34:23 -05:00
yindo closed this issue 2026-02-22 18:34:24 -05:00
yindo changed title from [PR #1667] Automatic live document sync to [PR #1667] [CLOSED] Automatic live document sync 2026-06-05 15:14:58 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#3737