[GH-ISSUE #1366] [BUG]: Can’t import a folder of docs containing other folders. #865

Closed
opened 2026-02-22 18:21:52 -05:00 by yindo · 14 comments
Owner

Originally created by @atljoseph on GitHub (May 11, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/1366

How are you running AnythingLLM?

Docker (local)

What happened?

Can’t upload a whole folder of documents. The folder contains other folders that contain documents.

For some reason, the file selector won’t let me select a whole folder either. Can only seem to upload single documents, or multiple single documents.

Also having a problem with drag and drop. Nothing happens. Nothing happens when dropping folders or files. It just doesn’t work.

Importing a whole folder at once is kind of crucial for usability.

It’d also be nice to be able to REPLACE documents easily. That also makes it easy to use. If it makes the user feel LESS FRAGMENTED, then it is providing value.

Are there known steps to reproduce?

On Ubuntu.

Click open and nothing happens.
IMG_1764

Nothing happens (drop folder).
IMG_1767

Nothing happens (drop file).
IMG_1768

Originally created by @atljoseph on GitHub (May 11, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/1366 ### How are you running AnythingLLM? Docker (local) ### What happened? Can’t upload a whole folder of documents. The folder contains other folders that contain documents. For some reason, the file selector won’t let me select a whole folder either. Can only seem to upload single documents, or multiple single documents. Also having a problem with drag and drop. Nothing happens. Nothing happens when dropping folders or files. It just doesn’t work. Importing a whole folder at once is kind of crucial for usability. It’d also be nice to be able to REPLACE documents easily. That also makes it easy to use. If it makes the user feel LESS FRAGMENTED, then it is providing value. ### Are there known steps to reproduce? On Ubuntu. Click open and nothing happens. ![IMG_1764](https://github.com/Mintplex-Labs/anything-llm/assets/25017621/77725d56-9a02-495f-981d-81dce196871c) Nothing happens (drop folder). ![IMG_1767](https://github.com/Mintplex-Labs/anything-llm/assets/25017621/6a720c09-f399-40a1-ae89-e8ddebec3ab3) Nothing happens (drop file). ![IMG_1768](https://github.com/Mintplex-Labs/anything-llm/assets/25017621/600b0a08-399b-4cd4-b808-762bb18c6991)
yindo added the possible bugneeds info / can't replicate labels 2026-02-22 18:21:52 -05:00
yindo closed this issue 2026-02-22 18:21:52 -05:00
Author
Owner

@timothycarambat commented on GitHub (May 11, 2024):

When you click on the file uploader, you can only select files. this is intentional and expected
Dragging and dropping files/folders does appear to work and I am unable to reproduce this bug at this time.

@timothycarambat commented on GitHub (May 11, 2024): When you click on the file uploader, you can only select files. _this is intentional and expected_ Dragging and dropping files/folders does appear to work and I am unable to reproduce this bug at this time.
Author
Owner

@atljoseph commented on GitHub (May 11, 2024):

Yeah it’s not working here on the drag drop. Just using Firefox and
whatever the ubuntu stock file app is.

Also the git repo feature doesn’t fetch files from sub folders.

On Sat, May 11, 2024 at 11:16 PM Timothy Carambat @.***>
wrote:

When you click on the file uploader, you can only select files. this is
intentional and expected

Dragging and dropping files/folders does appear to work and I am unable to
reproduce this bug at this time.


Reply to this email directly, view it on GitHub
https://github.com/Mintplex-Labs/anything-llm/issues/1366#issuecomment-2106102507,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AF632FNOJEHO4KBVYDLUGBLZB3NKJAVCNFSM6AAAAABHSNSK72VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMBWGEYDENJQG4
.
You are receiving this because you authored the thread.Message ID:
@.***>

@atljoseph commented on GitHub (May 11, 2024): Yeah it’s not working here on the drag drop. Just using Firefox and whatever the ubuntu stock file app is. Also the git repo feature doesn’t fetch files from sub folders. On Sat, May 11, 2024 at 11:16 PM Timothy Carambat ***@***.***> wrote: > When you click on the file uploader, you can only select files. *this is > intentional and expected* > Dragging and dropping files/folders does appear to work and I am unable to > reproduce this bug at this time. > > — > Reply to this email directly, view it on GitHub > <https://github.com/Mintplex-Labs/anything-llm/issues/1366#issuecomment-2106102507>, > or unsubscribe > <https://github.com/notifications/unsubscribe-auth/AF632FNOJEHO4KBVYDLUGBLZB3NKJAVCNFSM6AAAAABHSNSK72VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMBWGEYDENJQG4> > . > You are receiving this because you authored the thread.Message ID: > ***@***.***> >
Author
Owner

@atljoseph commented on GitHub (May 12, 2024):

If it is possible to drag drop folders (it’s still not for me…), then what is the purpose of blocking that action when selecting files? Seems a little inconsistent.

One BIG thing that is missing is the ability to bulk remove vector embeddings. Like, if you change your embedder, you have to swap things out. It isn’t automatically done, which is fine. But, really asking somebody to click this little undo icon 869 times to get rid of 869 files? That’s asking a lot of people.

Also getting a lot of page unresponsive error when having that many embeddings :/

@atljoseph commented on GitHub (May 12, 2024): If it is possible to drag drop folders (it’s still not for me…), then what is the purpose of blocking that action when selecting files? Seems a little inconsistent. One BIG thing that is missing is the ability to bulk remove vector embeddings. Like, if you change your embedder, you have to swap things out. It isn’t automatically done, which is fine. But, really asking somebody to click this little undo icon 869 times to get rid of 869 files? That’s asking a lot of people. Also getting a lot of page unresponsive error when having that many embeddings :/
Author
Owner

@frost19k commented on GitHub (May 12, 2024):

@atljoseph There a button to reset the database in the workspace settings

@frost19k commented on GitHub (May 12, 2024): @atljoseph There a button to reset the database in the workspace settings
Author
Owner

@atljoseph commented on GitHub (May 12, 2024):

Yeah but still a pain point when you have to swap out embeddings en masse,
but maybe not all of them.

I’d really like to see a way to have data sources that could have documents
or URL’s attached, and then you could refresh those by re-embedding them.
It’s like a reusable Refreshable thing instead of a one shot.

Right now it’s kind of in between those two and feels a bit clunky. Don’t
get me wrong. It works after things are embedded, and can still get value
from it. That’s more than can be said about Lang Chain.

On Sun, May 12, 2024 at 1:51 AM frost19k @.***> wrote:

@atljoseph https://github.com/atljoseph There a button to reset the
database in the workspace settings


Reply to this email directly, view it on GitHub
https://github.com/Mintplex-Labs/anything-llm/issues/1366#issuecomment-2106129387,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AF632FPVBT3RWZ4PITFIRLTZB37MVAVCNFSM6AAAAABHSNSK72VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMBWGEZDSMZYG4
.
You are receiving this because you were mentioned.Message ID:
@.***>

@atljoseph commented on GitHub (May 12, 2024): Yeah but still a pain point when you have to swap out embeddings en masse, but maybe not all of them. I’d really like to see a way to have data sources that could have documents or URL’s attached, and then you could refresh those by re-embedding them. It’s like a reusable Refreshable thing instead of a one shot. Right now it’s kind of in between those two and feels a bit clunky. Don’t get me wrong. It works after things are embedded, and can still get value from it. That’s more than can be said about Lang Chain. On Sun, May 12, 2024 at 1:51 AM frost19k ***@***.***> wrote: > @atljoseph <https://github.com/atljoseph> There a button to reset the > database in the workspace settings > > — > Reply to this email directly, view it on GitHub > <https://github.com/Mintplex-Labs/anything-llm/issues/1366#issuecomment-2106129387>, > or unsubscribe > <https://github.com/notifications/unsubscribe-auth/AF632FPVBT3RWZ4PITFIRLTZB37MVAVCNFSM6AAAAABHSNSK72VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMBWGEZDSMZYG4> > . > You are receiving this because you were mentioned.Message ID: > ***@***.***> >
Author
Owner

@atljoseph commented on GitHub (May 12, 2024):

Like for a confluence page. That’s cool to do. But that confluence page is
gonna change over time. Need an easier way to keep embeddings up to date.

On Sun, May 12, 2024 at 1:55 AM Joseph Gill @.***>
wrote:

Yeah but still a pain point when you have to swap out embeddings en masse,
but maybe not all of them.

I’d really like to see a way to have data sources that could have
documents or URL’s attached, and then you could refresh those by
re-embedding them. It’s like a reusable Refreshable thing instead of a one
shot.

Right now it’s kind of in between those two and feels a bit clunky. Don’t
get me wrong. It works after things are embedded, and can still get value
from it. That’s more than can be said about Lang Chain.

On Sun, May 12, 2024 at 1:51 AM frost19k @.***> wrote:

@atljoseph https://github.com/atljoseph There a button to reset the
database in the workspace settings


Reply to this email directly, view it on GitHub
https://github.com/Mintplex-Labs/anything-llm/issues/1366#issuecomment-2106129387,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AF632FPVBT3RWZ4PITFIRLTZB37MVAVCNFSM6AAAAABHSNSK72VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMBWGEZDSMZYG4
.
You are receiving this because you were mentioned.Message ID:
@.***>

@atljoseph commented on GitHub (May 12, 2024): Like for a confluence page. That’s cool to do. But that confluence page is gonna change over time. Need an easier way to keep embeddings up to date. On Sun, May 12, 2024 at 1:55 AM Joseph Gill ***@***.***> wrote: > Yeah but still a pain point when you have to swap out embeddings en masse, > but maybe not all of them. > > I’d really like to see a way to have data sources that could have > documents or URL’s attached, and then you could refresh those by > re-embedding them. It’s like a reusable Refreshable thing instead of a one > shot. > > Right now it’s kind of in between those two and feels a bit clunky. Don’t > get me wrong. It works after things are embedded, and can still get value > from it. That’s more than can be said about Lang Chain. > > On Sun, May 12, 2024 at 1:51 AM frost19k ***@***.***> wrote: > >> @atljoseph <https://github.com/atljoseph> There a button to reset the >> database in the workspace settings >> >> — >> Reply to this email directly, view it on GitHub >> <https://github.com/Mintplex-Labs/anything-llm/issues/1366#issuecomment-2106129387>, >> or unsubscribe >> <https://github.com/notifications/unsubscribe-auth/AF632FPVBT3RWZ4PITFIRLTZB37MVAVCNFSM6AAAAABHSNSK72VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMBWGEZDSMZYG4> >> . >> You are receiving this because you were mentioned.Message ID: >> ***@***.***> >> >
Author
Owner

@amirasyraf commented on GitHub (May 14, 2024):

Dragging folder does not seem to work reliably. I'm getting "File does not exist in upload directory.". I'm not sure what exactly it means by "not exist" here. The files are there. Is it failing to upload into its own directory?

In this instance, the folder I'm uploading contains several files and multiple levels of subfolders.

image

@amirasyraf commented on GitHub (May 14, 2024): Dragging folder does not seem to work reliably. I'm getting "File does not exist in upload directory.". I'm not sure what exactly it means by "not exist" here. The files are there. Is it failing to upload into its own directory? In this instance, the folder I'm uploading contains several files and multiple levels of subfolders. ![image](https://github.com/Mintplex-Labs/anything-llm/assets/15522007/0937f7b6-6e7f-42ea-9ef7-255dfc8c192e)
Author
Owner

@JKDevz commented on GitHub (May 14, 2024):

I am experiencing the same issue as @atljoseph, but I am not using Docker, just the LMStudio and AnythingLLM implementation.

@JKDevz commented on GitHub (May 14, 2024): I am experiencing the same issue as @atljoseph, but I am not using Docker, just the LMStudio and AnythingLLM implementation.
Author
Owner

@computersrmyfriends commented on GitHub (May 23, 2024):

I am not dragging and dropping. I am just selecting a single pdf file and it shows the same error for me

@computersrmyfriends commented on GitHub (May 23, 2024): I am not dragging and dropping. I am just selecting a single pdf file and it shows the same error for me
Author
Owner

@computersrmyfriends commented on GitHub (May 23, 2024):

image

Changed to a different PC with AVX2 support and I'm still struggling to get it up and running perfectly.

I am unable to upload files.

@computersrmyfriends commented on GitHub (May 23, 2024): ![image](https://github.com/Mintplex-Labs/anything-llm/assets/323931/cd43f4cc-eafa-4755-8593-c33010b4d741) Changed to a different PC with AVX2 support and I'm still struggling to get it up and running perfectly. I am unable to upload files.
Author
Owner

@Aliman00 commented on GitHub (Jun 26, 2024):

I'm having trouble when dragging and dropping files or folder, then I can just see a spinner with a timer but nothing is happening, even if it's very small file. Clicking on the box and then selecting file works, but drag and drop doesnt.

@Aliman00 commented on GitHub (Jun 26, 2024): I'm having trouble when dragging and dropping files or folder, then I can just see a spinner with a timer but nothing is happening, even if it's very small file. Clicking on the box and then selecting file works, but drag and drop doesnt.
Author
Owner

@azabraao commented on GitHub (Jul 29, 2024):

This issue seems to be fixed now. I was able to grab a folder with dozens of subfolders and files and drop it in the app.

@azabraao commented on GitHub (Jul 29, 2024): This issue seems to be fixed now. I was able to grab a folder with dozens of subfolders and files and drop it in the app.
Author
Owner

@JKDevz commented on GitHub (Jul 31, 2024):

That's awesome!

I'll was just thinking of giving mine another go again.

Will confirm the results later.


From: Abraão Azevedo @.>
Sent: Tuesday, July 30, 2024 2:45 AM
To: Mintplex-Labs/anything-llm @.
>
Cc: Jude Isaiah Cooksey @.>; Comment @.>
Subject: Re: [Mintplex-Labs/anything-llm] [BUG]: Can’t import a folder of docs containing other folders. (Issue #1366)

This issue seems to be fixed now. I was able to grab a folder with dozens of subfolders and files and drop it in the app.


Reply to this email directly, view it on GitHubhttps://github.com/Mintplex-Labs/anything-llm/issues/1366#issuecomment-2257253438, or unsubscribehttps://github.com/notifications/unsubscribe-auth/A2ZNKBBJZWMFTSA5OUYYWNTZO3O3RAVCNFSM6AAAAABHSNSK72VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDENJXGI2TGNBTHA.
You are receiving this because you commented.Message ID: @.***>

Disclaimer This email and the information contained herein are ADvTECH Ltd confidential and are protected by law. Please navigate to our website for more information https://www.advtech.co.za/ Use of this information or this email by any person for any purposes other than that for which it is intended is prohibited and may result in civil and/or criminal liability. This email is not to be shared with any 3rd parties not included within this email, without the written consent of its Author. If you have received this message in error, please notify ADvTECH immediately, telephone number +27 11 676 8000

@JKDevz commented on GitHub (Jul 31, 2024): That's awesome! I'll was just thinking of giving mine another go again. Will confirm the results later. ________________________________ From: Abraão Azevedo ***@***.***> Sent: Tuesday, July 30, 2024 2:45 AM To: Mintplex-Labs/anything-llm ***@***.***> Cc: Jude Isaiah Cooksey ***@***.***>; Comment ***@***.***> Subject: Re: [Mintplex-Labs/anything-llm] [BUG]: Can’t import a folder of docs containing other folders. (Issue #1366) This issue seems to be fixed now. I was able to grab a folder with dozens of subfolders and files and drop it in the app. — Reply to this email directly, view it on GitHub<https://github.com/Mintplex-Labs/anything-llm/issues/1366#issuecomment-2257253438>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/A2ZNKBBJZWMFTSA5OUYYWNTZO3O3RAVCNFSM6AAAAABHSNSK72VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDENJXGI2TGNBTHA>. You are receiving this because you commented.Message ID: ***@***.***> Disclaimer This email and the information contained herein are ADvTECH Ltd confidential and are protected by law. Please navigate to our website for more information https://www.advtech.co.za/ Use of this information or this email by any person for any purposes other than that for which it is intended is prohibited and may result in civil and/or criminal liability. This email is not to be shared with any 3rd parties not included within this email, without the written consent of its Author. If you have received this message in error, please notify ADvTECH immediately, telephone number +27 11 676 8000
Author
Owner

@timothycarambat commented on GitHub (Jul 31, 2024):

You have to drag and drop, not click 👍

@timothycarambat commented on GitHub (Jul 31, 2024): You have to drag and drop, not click 👍
yindo changed title from [BUG]: Can’t import a folder of docs containing other folders. to [GH-ISSUE #1366] [BUG]: Can’t import a folder of docs containing other folders. 2026-06-05 14:37:38 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#865