Mintplex-Labs/anything-llm
1
0
Fork 0
mirror of https://github.com/Mintplex-Labs/anything-llm.git synced 2026-07-19 22:23:50 -04:00
Code Issues 328 Packages Projects Releases 10 Wiki Activity

[GH-ISSUE #1931] [DOCS]: I'm confused at why I need to upload a document? #1254

New Issue
Closed
opened 2026-02-22 18:23:56 -05:00 by yindo · 5 comments
yindo commented 2026-02-22 18:23:56 -05:00
Owner
Copy Link
Copy Source

Originally created by @easaw on GitHub (Jul 23, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/1931

Description

I have had a look at the docs, and maybe I'm understanding the purpose of this.

I have Ollama running fine and using the localhost version.

Why do I need an internet connection to 'upload' files? Why is document interaction not done locally?

Thank you.

Originally created by @easaw on GitHub (Jul 23, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/1931 ### Description I have had a look at the docs, and maybe I'm understanding the purpose of this. I have Ollama running fine and using the localhost version. Why do I need an internet connection to 'upload' files? Why is document interaction not done locally? Thank you.
yindo added the documentation label 2026-02-22 18:23:56 -05:00
yindo closed this issue 2026-02-22 18:23:56 -05:00
yindo commented 2026-02-22 18:23:56 -05:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (Jul 23, 2024):

You do not need an internet connection to upload a document. This issue does not describe what you are attempting to do, but you can upload, embed and chat with AnythingLLM without an internet connection. Without more details I cannot help debug what exactly you are running into.

@timothycarambat commented on GitHub (Jul 23, 2024): You do not need an internet connection to upload a document. This issue does not describe what you are attempting to do, but you can upload, embed and chat with AnythingLLM without an internet connection. Without more details I cannot help debug what exactly you are running into.
yindo commented 2026-02-22 18:23:56 -05:00
Author
Owner
Copy Link
Copy Source

@george-holt commented on GitHub (Jul 27, 2024):

@timothycarambat - I had the same question. I'm running a single-user instance is there a way to scan a list of folders for new content? Use case: I use Obsidian for notes. For the most part it's just markdown files. I would love to have anything-llm to scan a list of local directories.

I think to do this on my own, I would use a file sync tool to copy content into the upload folder... but then I started wondering about file versioning and how multiple versions of a file would get added into the vector database.

Do you have a suggestion on how to best handle this use case with the existing product?

@george-holt commented on GitHub (Jul 27, 2024): @timothycarambat - I had the same question. I'm running a single-user instance is there a way to scan a list of folders for new content? Use case: I use Obsidian for notes. For the most part it's just markdown files. I would love to have anything-llm to scan a list of local directories. I think to do this on my own, I would use a file sync tool to copy content into the upload folder... but then I started wondering about file versioning and how multiple versions of a file would get added into the vector database. Do you have a suggestion on how to best handle this use case with the existing product?
yindo commented 2026-02-22 18:23:56 -05:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (Jul 27, 2024):

@george-holt We have a beta feature for document sync and have an open issues specifically for Obsidan as well (which we will sync too).

When it comes to syncing we upsert new embeddings when a document changes and don't multi-version it so data is not duplicated!

We are actually going to make the local watcher more robust so you can watch entire directories and sub-files and such - which is why it is in beta. The currently implementation is not very performant so we are going to migrate this to chokdir so we can listen to fs events native in the system without a large overhead.

@timothycarambat commented on GitHub (Jul 27, 2024): @george-holt We have a [beta feature for document sync](https://docs.anythingllm.com/beta-preview/active-features/live-document-sync) and have an open issues [_specifically_ for Obsidan ](https://github.com/Mintplex-Labs/anything-llm/issues/1400) as well (which we will sync too). When it comes to syncing we _upsert_ new embeddings when a document changes and don't multi-version it so data is not duplicated! We are actually going to make the local watcher more robust so you can watch entire directories and sub-files and such - which is why it is in beta. The currently implementation is not very performant so we are going to migrate this to `chokdir` so we can listen to `fs` events native in the system without a large overhead.
yindo commented 2026-02-22 18:23:57 -05:00
Author
Owner
Copy Link
Copy Source

@easaw commented on GitHub (Aug 29, 2024):

I know it's a while later, but I'd like to come back to this. I've seen similar issues regarding:

"Document Processor Unavailable"
"We can't upload your files right now because the document processor is offline. Please try again later."

I assumed 'offline' meant no internet, but perhaps I was wrong. Is there something the processor needs?
I can confirm AnythingLLM can connect to the internet, as while I am running Ollama, before that I allowed it to start downloading one of the models.

I have just installed the latest 1.6.4 on a Apple silicone MBP.

Screenshot 2024-08-29 at 21 01 55

As you can see I'm unable to 'upload' files.

Thank you.

@easaw commented on GitHub (Aug 29, 2024): I know it's a while later, but I'd like to come back to this. I've seen similar issues regarding: > "Document Processor Unavailable" "We can't upload your files right now because the document processor is offline. Please try again later." I assumed 'offline' meant no internet, but perhaps I was wrong. Is there something the processor needs? I can confirm AnythingLLM can connect to the internet, as while I am running Ollama, before that I allowed it to start downloading one of the models. I have just installed the latest 1.6.4 on a Apple silicone MBP. ![Screenshot 2024-08-29 at 21 01 55](https://github.com/user-attachments/assets/7f3836a8-41d6-4bd3-8458-19f00fa4fa10) As you can see I'm unable to 'upload' files. Thank you.
yindo commented 2026-02-22 18:23:57 -05:00
Author
Owner
Copy Link
Copy Source

@easaw commented on GitHub (Aug 29, 2024):

I can confirm this solved the issue:

https://giter.vip/mintplex-labs/anything-llm/issues/866

Terminal run: /Users/username/Applications/AnythingLLM.app/Contents/MacOS/AnythingLLM

However, when I then launch that by clicking the app in ~/Applications, it gives me a warning:

Screenshot warning damaged

@easaw commented on GitHub (Aug 29, 2024): I can confirm this solved the issue: https://giter.vip/mintplex-labs/anything-llm/issues/866 > Terminal run: `/Users/username/Applications/AnythingLLM.app/Contents/MacOS/AnythingLLM` However, when I then launch that by clicking the app in ~/Applications, it gives me a warning: ![Screenshot warning damaged](https://github.com/user-attachments/assets/d6b37911-fde6-4cf6-be2a-eacb42a6f771)
yindo changed title from [DOCS]: I'm confused at why I need to upload a document? to [GH-ISSUE #1931] [DOCS]: I'm confused at why I need to upload a document? 2026-06-05 14:39:46 -04:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Desktop
Docker
Integration Request
Integration Request
OS: Linux
OS: Mobile
OS: Windows
UI/UX
blocked
bug
bug
core-team-only
documentation
duplicate
embed-widget
enhancement
feature request
github_actions
good first issue
investigating
needs info / can't replicate
possible bug
pull-request
Mirrored from GitHub Pull Request
 question
stage: specifications
wontfix
No Label documentation
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#1254
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?