[GH-ISSUE #1364] [BUG]: GitHub subfolders not followed. #862

Closed
opened 2026-02-22 18:21:51 -05:00 by yindo · 5 comments
Owner

Originally created by @atljoseph on GitHub (May 11, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/1364

How are you running AnythingLLM?

Docker (local)

What happened?

See the pictures. The GitHub url has a lot of subfolders and none of them ever made it into the documents.

Are there known steps to reproduce?

IMG_1761
IMG_1759
IMG_1760

Also, is this button supposed to do anything? Nothing happens when clicking it.
IMG_1762

Can you elevate data connections so that they are saved on their own, and at the click of a button, someone can refresh those data sources… not sure how that would affect other workspaces, but I’d be ok with a side effect from that.

Originally created by @atljoseph on GitHub (May 11, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/1364 ### How are you running AnythingLLM? Docker (local) ### What happened? See the pictures. The GitHub url has a lot of subfolders and none of them ever made it into the documents. ### Are there known steps to reproduce? ![IMG_1761](https://github.com/Mintplex-Labs/anything-llm/assets/25017621/0cbd9541-6f33-4b7b-94b5-8f20cfcd718f) ![IMG_1759](https://github.com/Mintplex-Labs/anything-llm/assets/25017621/7f4a741c-c4bf-4b14-b704-41a781c1e0eb) ![IMG_1760](https://github.com/Mintplex-Labs/anything-llm/assets/25017621/52e782b1-5803-4476-8b60-fd768756c5f9) Also, is this button supposed to do anything? Nothing happens when clicking it. ![IMG_1762](https://github.com/Mintplex-Labs/anything-llm/assets/25017621/b0044ab0-e721-4360-9f2b-1bbf2a032e4c) Can you elevate data connections so that they are saved on their own, and at the click of a button, someone can refresh those data sources… not sure how that would affect other workspaces, but I’d be ok with a side effect from that.
yindo added the possible bug label 2026-02-22 18:21:51 -05:00
yindo closed this issue 2026-02-22 18:21:51 -05:00
Author
Owner

@atljoseph commented on GitHub (May 11, 2024):

Same with https://github.com/ollama/ollama

@atljoseph commented on GitHub (May 11, 2024): Same with https://github.com/ollama/ollama
Author
Owner

@timothycarambat commented on GitHub (May 11, 2024):

You need a PAT to access sub-folders due to rate-limiting
https://github.com/Mintplex-Labs/anything-llm/issues/1305#issuecomment-2100972013

@timothycarambat commented on GitHub (May 11, 2024): You need a PAT to access sub-folders due to rate-limiting https://github.com/Mintplex-Labs/anything-llm/issues/1305#issuecomment-2100972013
Author
Owner

@atljoseph commented on GitHub (May 11, 2024):

Can you add that to the information displayed on the page? It mentions that
token and why it is needed, but doesn’t mention or infer sub folders.

On Sat, May 11, 2024 at 11:23 PM Timothy Carambat @.***>
wrote:

You need a PAT to access sub-folders due to rate-limiting
#1305 (comment)
https://github.com/Mintplex-Labs/anything-llm/issues/1305#issuecomment-2100972013


Reply to this email directly, view it on GitHub
https://github.com/Mintplex-Labs/anything-llm/issues/1364#issuecomment-2106103644,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AF632FMW6M4LN4BEOPJLSITZB3OBXAVCNFSM6AAAAABHSHHFO2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMBWGEYDGNRUGQ
.
You are receiving this because you authored the thread.Message ID:
@.***>

@atljoseph commented on GitHub (May 11, 2024): Can you add that to the information displayed on the page? It mentions that token and why it is needed, but doesn’t mention or infer sub folders. On Sat, May 11, 2024 at 11:23 PM Timothy Carambat ***@***.***> wrote: > You need a PAT to access sub-folders due to rate-limiting > #1305 (comment) > <https://github.com/Mintplex-Labs/anything-llm/issues/1305#issuecomment-2100972013> > > — > Reply to this email directly, view it on GitHub > <https://github.com/Mintplex-Labs/anything-llm/issues/1364#issuecomment-2106103644>, > or unsubscribe > <https://github.com/notifications/unsubscribe-auth/AF632FMW6M4LN4BEOPJLSITZB3OBXAVCNFSM6AAAAABHSHHFO2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMBWGEYDGNRUGQ> > . > You are receiving this because you authored the thread.Message ID: > ***@***.***> >
Author
Owner

@atljoseph commented on GitHub (May 11, 2024):

And when you enter a token, is that somehow remembered?

On Sat, May 11, 2024 at 11:25 PM Joseph Gill @.***>
wrote:

Can you add that to the information displayed on the page? It mentions
that token and why it is needed, but doesn’t mention or infer sub folders.

On Sat, May 11, 2024 at 11:23 PM Timothy Carambat <
@.***> wrote:

You need a PAT to access sub-folders due to rate-limiting
#1305 (comment)
https://github.com/Mintplex-Labs/anything-llm/issues/1305#issuecomment-2100972013


Reply to this email directly, view it on GitHub
https://github.com/Mintplex-Labs/anything-llm/issues/1364#issuecomment-2106103644,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AF632FMW6M4LN4BEOPJLSITZB3OBXAVCNFSM6AAAAABHSHHFO2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMBWGEYDGNRUGQ
.
You are receiving this because you authored the thread.Message ID:
@.***>

@atljoseph commented on GitHub (May 11, 2024): And when you enter a token, is that somehow remembered? On Sat, May 11, 2024 at 11:25 PM Joseph Gill ***@***.***> wrote: > Can you add that to the information displayed on the page? It mentions > that token and why it is needed, but doesn’t mention or infer sub folders. > > On Sat, May 11, 2024 at 11:23 PM Timothy Carambat < > ***@***.***> wrote: > >> You need a PAT to access sub-folders due to rate-limiting >> #1305 (comment) >> <https://github.com/Mintplex-Labs/anything-llm/issues/1305#issuecomment-2100972013> >> >> — >> Reply to this email directly, view it on GitHub >> <https://github.com/Mintplex-Labs/anything-llm/issues/1364#issuecomment-2106103644>, >> or unsubscribe >> <https://github.com/notifications/unsubscribe-auth/AF632FMW6M4LN4BEOPJLSITZB3OBXAVCNFSM6AAAAABHSHHFO2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMBWGEYDGNRUGQ> >> . >> You are receiving this because you authored the thread.Message ID: >> ***@***.***> >> >
Author
Owner

@atljoseph commented on GitHub (May 12, 2024):

Had to do this about 4-5 times right now, and yeah… can you have a way for
things like this to be initialized from an environment variable? That
wouldn’t fix everything, but it would make things pretty easy for folks who
use this locally. Should be pretty easy to just put a process.env in on
startup to inject a value.

On Sat, May 11, 2024 at 11:31 PM Joseph Gill @.***>
wrote:

And when you enter a token, is that somehow remembered?

On Sat, May 11, 2024 at 11:25 PM Joseph Gill <
@.***> wrote:

Can you add that to the information displayed on the page? It mentions
that token and why it is needed, but doesn’t mention or infer sub folders.

On Sat, May 11, 2024 at 11:23 PM Timothy Carambat <
@.***> wrote:

You need a PAT to access sub-folders due to rate-limiting
#1305 (comment)
https://github.com/Mintplex-Labs/anything-llm/issues/1305#issuecomment-2100972013


Reply to this email directly, view it on GitHub
https://github.com/Mintplex-Labs/anything-llm/issues/1364#issuecomment-2106103644,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AF632FMW6M4LN4BEOPJLSITZB3OBXAVCNFSM6AAAAABHSHHFO2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMBWGEYDGNRUGQ
.
You are receiving this because you authored the thread.Message ID:
@.***>

@atljoseph commented on GitHub (May 12, 2024): Had to do this about 4-5 times right now, and yeah… can you have a way for things like this to be initialized from an environment variable? That wouldn’t fix everything, but it would make things pretty easy for folks who use this locally. Should be pretty easy to just put a process.env in on startup to inject a value. On Sat, May 11, 2024 at 11:31 PM Joseph Gill ***@***.***> wrote: > And when you enter a token, is that somehow remembered? > > On Sat, May 11, 2024 at 11:25 PM Joseph Gill < > ***@***.***> wrote: > >> Can you add that to the information displayed on the page? It mentions >> that token and why it is needed, but doesn’t mention or infer sub folders. >> >> On Sat, May 11, 2024 at 11:23 PM Timothy Carambat < >> ***@***.***> wrote: >> >>> You need a PAT to access sub-folders due to rate-limiting >>> #1305 (comment) >>> <https://github.com/Mintplex-Labs/anything-llm/issues/1305#issuecomment-2100972013> >>> >>> — >>> Reply to this email directly, view it on GitHub >>> <https://github.com/Mintplex-Labs/anything-llm/issues/1364#issuecomment-2106103644>, >>> or unsubscribe >>> <https://github.com/notifications/unsubscribe-auth/AF632FMW6M4LN4BEOPJLSITZB3OBXAVCNFSM6AAAAABHSHHFO2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMBWGEYDGNRUGQ> >>> . >>> You are receiving this because you authored the thread.Message ID: >>> ***@***.***> >>> >>
yindo changed title from [BUG]: GitHub subfolders not followed. to [GH-ISSUE #1364] [BUG]: GitHub subfolders not followed. 2026-06-05 14:37:37 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#862