[PR #469] [MERGED] GitHub loader extension + extension support v1 #3366

Closed
opened 2026-02-22 18:33:38 -05:00 by yindo · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/Mintplex-Labs/anything-llm/pull/469
Author: @timothycarambat
Created: 12/18/2023
Status: Merged
Merged: 12/18/2023
Merged by: @timothycarambat

Base: masterHead: 101-github-loader-extension


📝 Commits (10+)

  • e991ccd feat: implement github repo loading
  • 52dfc93 noshow delete on custom-documents
  • c46b2b2 Add API key support because of rate limits
  • ff29ec9 WIP for frontend of data connectors
  • 230147d wip
  • 5c436bd merge with master
  • 0892c89 Add frontend form for GitHub repo data connector
  • 8efeeaf remove console.logs
  • 6f9280c remove _meta unused arg
  • 0460b7f Add support for ignore pathing in request

📊 Changes

32 files changed (+975 additions, -128 deletions)

View changed files

collector/extensions/index.js (+52 -0)
📝 collector/index.js (+3 -0)
📝 collector/package.json (+3 -1)
collector/utils/extensions/GithubRepo/RepoLoader/index.js (+149 -0)
collector/utils/extensions/GithubRepo/index.js (+78 -0)
📝 collector/yarn.lock (+10 -0)
📝 frontend/package.json (+1 -0)
📝 frontend/src/App.jsx (+15 -0)
frontend/src/components/DataConnectorOption/index.jsx (+39 -0)
frontend/src/components/DataConnectorOption/media/github.png (+0 -0)
frontend/src/components/DataConnectorOption/media/index.js (+5 -0)
📝 frontend/src/components/Modals/MangeWorkspace/Documents/Directory/FileRow/index.jsx (+2 -2)
📝 frontend/src/components/Modals/MangeWorkspace/Documents/Directory/FolderRow/index.jsx (+37 -5)
📝 frontend/src/components/Modals/MangeWorkspace/Documents/Directory/index.jsx (+1 -0)
📝 frontend/src/components/SettingsSidebar/index.jsx (+6 -0)
frontend/src/components/Sidebar/IndexCount.jsx (+0 -34)
frontend/src/components/Sidebar/LLMStatus.jsx (+0 -49)
📝 frontend/src/components/Sidebar/index.jsx (+0 -19)
📝 frontend/src/index.css (+4 -0)
frontend/src/models/dataConnector.js (+47 -0)

...and 12 more files

📄 Description

  • Add first data connector (GitHub Repo)
  • Add folder support so we can have multiple folders not
  • Delete non-root document folder for bulk deletion
  • add extension endpoint support for Server/Document processor

resolves #101


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/Mintplex-Labs/anything-llm/pull/469 **Author:** [@timothycarambat](https://github.com/timothycarambat) **Created:** 12/18/2023 **Status:** ✅ Merged **Merged:** 12/18/2023 **Merged by:** [@timothycarambat](https://github.com/timothycarambat) **Base:** `master` ← **Head:** `101-github-loader-extension` --- ### 📝 Commits (10+) - [`e991ccd`](https://github.com/Mintplex-Labs/anything-llm/commit/e991ccd17f668c508280bd87dd5b13dec26818ad) feat: implement github repo loading - [`52dfc93`](https://github.com/Mintplex-Labs/anything-llm/commit/52dfc9397d890e60b1d3ebcca077f5426728b06b) noshow delete on custom-documents - [`c46b2b2`](https://github.com/Mintplex-Labs/anything-llm/commit/c46b2b217b27ef959adef03a2d4f69916fecd8b1) Add API key support because of rate limits - [`ff29ec9`](https://github.com/Mintplex-Labs/anything-llm/commit/ff29ec9d9b4b4c29f4e51b75b8277bd6141dbf3e) WIP for frontend of data connectors - [`230147d`](https://github.com/Mintplex-Labs/anything-llm/commit/230147d12c5932dc9c0a65a7337f0462f29384bd) wip - [`5c436bd`](https://github.com/Mintplex-Labs/anything-llm/commit/5c436bdac49117f16855bf85da48abda1eb38cb0) merge with master - [`0892c89`](https://github.com/Mintplex-Labs/anything-llm/commit/0892c8942934ef9c3a7644268b383d96d19dcb2d) Add frontend form for GitHub repo data connector - [`8efeeaf`](https://github.com/Mintplex-Labs/anything-llm/commit/8efeeaf372eb01559e5f05b3ea5ecd0ce0f8e650) remove console.logs - [`6f9280c`](https://github.com/Mintplex-Labs/anything-llm/commit/6f9280cc0cf313ab9b2062647dd6dc075a90b3ea) remove _meta unused arg - [`0460b7f`](https://github.com/Mintplex-Labs/anything-llm/commit/0460b7fe313bdfadd941e16daecbc1fccb757fa3) Add support for ignore pathing in request ### 📊 Changes **32 files changed** (+975 additions, -128 deletions) <details> <summary>View changed files</summary> ➕ `collector/extensions/index.js` (+52 -0) 📝 `collector/index.js` (+3 -0) 📝 `collector/package.json` (+3 -1) ➕ `collector/utils/extensions/GithubRepo/RepoLoader/index.js` (+149 -0) ➕ `collector/utils/extensions/GithubRepo/index.js` (+78 -0) 📝 `collector/yarn.lock` (+10 -0) 📝 `frontend/package.json` (+1 -0) 📝 `frontend/src/App.jsx` (+15 -0) ➕ `frontend/src/components/DataConnectorOption/index.jsx` (+39 -0) ➕ `frontend/src/components/DataConnectorOption/media/github.png` (+0 -0) ➕ `frontend/src/components/DataConnectorOption/media/index.js` (+5 -0) 📝 `frontend/src/components/Modals/MangeWorkspace/Documents/Directory/FileRow/index.jsx` (+2 -2) 📝 `frontend/src/components/Modals/MangeWorkspace/Documents/Directory/FolderRow/index.jsx` (+37 -5) 📝 `frontend/src/components/Modals/MangeWorkspace/Documents/Directory/index.jsx` (+1 -0) 📝 `frontend/src/components/SettingsSidebar/index.jsx` (+6 -0) ➖ `frontend/src/components/Sidebar/IndexCount.jsx` (+0 -34) ➖ `frontend/src/components/Sidebar/LLMStatus.jsx` (+0 -49) 📝 `frontend/src/components/Sidebar/index.jsx` (+0 -19) 📝 `frontend/src/index.css` (+4 -0) ➕ `frontend/src/models/dataConnector.js` (+47 -0) _...and 12 more files_ </details> ### 📄 Description - Add first data connector (GitHub Repo) - Add folder support so we can have multiple folders not - Delete non-root document folder for bulk deletion - add extension endpoint support for Server/Document processor resolves #101 --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-22 18:33:38 -05:00
yindo closed this issue 2026-02-22 18:33:38 -05:00
yindo changed title from [PR #469] GitHub loader extension + extension support v1 to [PR #469] [MERGED] GitHub loader extension + extension support v1 2026-06-05 15:13:03 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#3366