Mintplex-Labs/anything-llm
1
0
Fork 0
mirror of https://github.com/Mintplex-Labs/anything-llm.git synced 2026-07-19 14:13:35 -04:00
Code Issues 328 Packages Projects Releases 10 Wiki Activity

[GH-ISSUE #1333] [FEAT]: Show supported documents type when uploading files #842

New Issue
Closed
opened 2026-02-22 18:21:43 -05:00 by yindo · 5 comments
yindo commented 2026-02-22 18:21:43 -05:00
Owner
Copy Link
Copy Source

Originally created by @jazelly on GitHub (May 10, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/1333

What would you like to see?

Hi, this is such amazing repo.

Wouldn't it be great to show supported documents types?

Originally created by @jazelly on GitHub (May 10, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/1333 ### What would you like to see? Hi, this is such amazing repo. Wouldn't it be great to show supported documents types?
yindo added the enhancementfeature request labels 2026-02-22 18:21:43 -05:00
yindo closed this issue 2026-02-22 18:21:43 -05:00
yindo commented 2026-02-22 18:21:44 -05:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (May 10, 2024):

We used to, but then there were dozens of filetypes and it got really messy. Now we just allow any file types because there are basically unlimited amounts of them.

Anything that can be text is turned to text now. Anything that requires a special handlers is handled via the asXYZ.js in collector/utils/convert

@timothycarambat commented on GitHub (May 10, 2024): We used to, but then there were dozens of filetypes and it got really messy. Now we just allow any file types because there are basically unlimited amounts of them. Anything that can be text is turned to text now. Anything that requires a special handlers is handled via the `asXYZ.js` in `collector/utils/convert`
yindo commented 2026-02-22 18:21:44 -05:00
Author
Owner
Copy Link
Copy Source

@LvargaDS commented on GitHub (Dec 11, 2025):

I do see that text types are being detected using this source file https://github.com/Mintplex-Labs/anything-llm/blob/master/collector/utils/files/mime.js

My guess is that only text types are being parsed now https://github.com/Mintplex-Labs/anything-llm/blob/master/collector/utils/files/index.js#L31

Or do I see it wrong?

PS: I was trying to find out, whenever tar archive with text files (without any extensions!) are being recognized.

@LvargaDS commented on GitHub (Dec 11, 2025): I do see that text types are being detected using this source file https://github.com/Mintplex-Labs/anything-llm/blob/master/collector/utils/files/mime.js My guess is that only text types are being parsed now https://github.com/Mintplex-Labs/anything-llm/blob/master/collector/utils/files/index.js#L31 Or do I see it wrong? PS: I was trying to find out, whenever tar archive with text files (without any extensions!) are being recognized.
yindo commented 2026-02-22 18:21:44 -05:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (Dec 11, 2025):

@LvargaDS if we dont have a dedicated mapping for a file then we will attempt to read it as text. This handles the majority of files but .tar will for sure fail and .zip is explicitly blocked for security and zip-bombing

@timothycarambat commented on GitHub (Dec 11, 2025): @LvargaDS if we dont have a dedicated mapping for a file then we will attempt to read it as text. This handles the majority of files but `.tar` will for sure fail and [`.zip` is explicitly blocked](https://github.com/Mintplex-Labs/anything-llm/blob/baab837b5886190f951e9958a049bf0ca6948573/collector/utils/files/mime.js#L6C5-L6C23) for security and zip-bombing
yindo commented 2026-02-22 18:21:44 -05:00
Author
Owner
Copy Link
Copy Source

@LvargaDS commented on GitHub (Dec 12, 2025):

It is a bit unfortunate, that there is currently no way, how to provide local knowledge base scattered in many files...
My best approach is currently to import those "wiki like" pages into a git repo and than use git connector to import whole list of files. Zip (or tar, or even tar.gz) would be a bit easier to use for my usecase, but I think git workaround is ok).
Please let me know, if there is better way to achieve this.

@LvargaDS commented on GitHub (Dec 12, 2025): It is a bit unfortunate, that there is currently no way, how to provide local knowledge base scattered in many files... My best approach is currently to import those "wiki like" pages into a git repo and than use git connector to import whole list of files. Zip (or tar, or even tar.gz) would be a bit easier to use for my usecase, but I think git workaround is ok). Please let me know, if there is better way to achieve this.
yindo commented 2026-02-22 18:21:44 -05:00
Author
Owner
Copy Link
Copy Source

@kaydol commented on GitHub (Feb 18, 2026):

It is a bit unfortunate, that there is currently no way, how to provide local knowledge base scattered in many files... My best approach is currently to import those "wiki like" pages into a git repo and than use git connector to import whole list of files. Zip (or tar, or even tar.gz) would be a bit easier to use for my usecase, but I think git workaround is ok). Please let me know, if there is better way to achieve this.

I was able to temporarily serve a local folder as a website with the help of https://github.com/dector/serv , then scraped said website (http://localhost:port or http://host.docker.internal:port). The only problem is that the scraper does not allow to scrape more than 5 folders deep

EDIT: that didn't quite work, the resulting json files of the pages have a 404 not found text in them

@kaydol commented on GitHub (Feb 18, 2026): > It is a bit unfortunate, that there is currently no way, how to provide local knowledge base scattered in many files... My best approach is currently to import those "wiki like" pages into a git repo and than use git connector to import whole list of files. Zip (or tar, or even tar.gz) would be a bit easier to use for my usecase, but I think git workaround is ok). Please let me know, if there is better way to achieve this. I was able to temporarily serve a local folder as a website with the help of https://github.com/dector/serv , then scraped said website (http://localhost:port or http://host.docker.internal:port). The only problem is that the scraper does not allow to scrape more than 5 folders deep EDIT: that didn't quite work, the resulting json files of the pages have a 404 not found text in them
yindo changed title from [FEAT]: Show supported documents type when uploading files to [GH-ISSUE #1333] [FEAT]: Show supported documents type when uploading files 2026-06-05 14:37:30 -04:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Desktop
Docker
Integration Request
Integration Request
OS: Linux
OS: Mobile
OS: Windows
UI/UX
blocked
bug
bug
core-team-only
documentation
duplicate
embed-widget
enhancement
feature request
github_actions
good first issue
investigating
needs info / can't replicate
possible bug
pull-request
Mirrored from GitHub Pull Request
 question
stage: specifications
wontfix
No Label enhancement feature request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#842
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?