mirror of
https://github.com/Mintplex-Labs/anything-llm.git
synced 2026-07-19 14:13:35 -04:00
[GH-ISSUE #821] [BUG]: (fetch failed on embed) HuggingFace/Xenova blocking download from user IP #479
Closed
opened 2026-02-22 18:19:41 -05:00 by yindo
·
22 comments
No Branch/Tag Specified
master
5846-bug-when-scrolling-up-scrolling-jumps
refactor-remove-workspace-pfp
5969-bug-stopgenerationbutton-disappears-on-the-first-prompt-that-initiates-an-agent-session
2235-bug-how-to-upload-a-folder-with-subfolders-with-files-to-anythingllm
5990-workspace-update-fails-with-unknown-argument-router_id-v1130v1150-intel-mac
opencomputer-examples
pg
feat/image-generation-translations
feat/image-generation
5924-bug-meeting-summary-fails-with-sincludes-is-not-a-function-when-default-llm-is-anthropic-claude
render
feat/uniform-modal-component
5883-bug-unescaped-content-in-json-strings-being-passed-to-document-generator-tools
5901-bug-api-update-embeddings-fails-prisma-argument-filename-is-missing-on-workspace_documentscreate-desktop-windows-v1141
hybrid-search
1981-translations
5752-bug-prompts-to-local-jan-endpoint-unresponsive
feat-disable-native-tool-calling-env-var
5676-bug-non-ollama-agent-providers-do-not-parse-and-present-reasoning-content
feat/markdown-web-scraping
5717-bug-apiv1documentupload-silently-drops-metadata-field-in-desktop-1130-arg-count-mismatch-nested-payload-key
fix/aibitat-context-overflow
5711-bug-erratic-deepseek-v4-flash-the-agent-model-failed-to-respond-400-the-reasoning_content
5631-feat-custom-api-request-timeouts-for-ai-providers
feat-reasoning-control
feat-agent-clarifying-questions-translations
5583-bug-lm-studio-provider-does-not-present-reasoning-output
5313-normalize-translations
feat/memory-translations
5305-lemonade-embedding-engine-swallows-errors-falsely-reports-documents-as-embedded
5060-bug-agent-interactions-agent-are-not-persisted-to-thread-history-via-api
pptx-subagent
feat-render-images-from-mcp-tool-results
stt-provider-expansion-openai-api-compatible
feat-file-search-agent-tool
feat-native-embedder-job-queue
5189-normalize-translations
feat-file-search-agent-tool-translations
i18n-eslint
5140-auto-migration
5112-bug-openrouter-failed-message-bug
3506-feat-parameters-for-openrouter-models
4992-feat-preserve-scroll-position
4973-bug-markdown-numbered-list-display-in-reasoning-pane
desktop
4938-bug-pending-chat-rerendering-ui-bug
quickstart-env
node-llama-cpp-in-container-cuda
node-llama-cpp-in-container
ollama-in-container
4817-feat-set-cooldown-per-mcp-server
4845-keyboard-shortcuts-to-navigate-in-chat
4844-feat-reorder-threads-by-latest-interaction
standardize-username-constraints-normalize-translations
4792-feat-refactor-workspacepfp-image
1382-embed-ip-improvements
1382-bug-embed-api-improvements
refactor-eslint-frontend
4687-feat-refactor-vector-db-providers
4615-feat-disable-apidocs-with-environment-variable
4559-feat-agent-web-search-enable-ordering-of-results
4599-bug-ollama-race-condition-bug
4572-bug-lmstudio-provided-llm-stopped-working-with-anything-llm-after-upgrading-to-190
4508-agent-youtube-transcript-analysis
4497-feat-workspace-names
frontend-eslint
ollama-lmstudio-auto-context-window
4431-validate-vector-database-connectioN
2019-slash-command-keyboard-selection
microsoft-foundry-provider
4431-validate-vector-database-connection
4325-sys-prompt-var-improvements
3209-feat-apiv1workspacestream-chat-sources-citations
4210-bug-voice-to-text-overwrite
4136-feat-jan-as-a-backend-server-option
4172-feat-openai-o3-support
1.8.3-rerelease
web-push-notifications-service
tasks
3955-feat-jinaai-embedder-provider-support
3921-feat-agent-skills-uiux-improvements
3901-bug-validfunccall-checks-optional-arguments
keyboard-dev
1787-custom-roles-and-permissions
add-jira-slack-data-connector
office-extension-wip
lightmode-dropdown-color-update
3586-bug-agent-flow-function-description-provided-by-user-is-not-seen-in-the-llm-query
3463-bug-agent-continues-to-run-if-request-failed-even-after-exit
3439-feat-call-variables-within-the-flow-api-block-url-field
3282-manager-view-models-workspace
3280-token-counting-server-side-truncation-improvements
3147-bug-embedded-chat-widget---not-considering-query-mode-option-always-working-in-chat-mode
2995-feat-disable-temperature-setting-for-deepseek-r1-deepseek-reasoner-model
2827-feat-perplexity-citations
2866-feat-finally-a-gemini-models-endpoint
2647-feat-hpp-header-for-a-c++-code-file-mime-addition
lancedb-revert
1656-feat-implement-tooltip-ui-designs
2011-feat-bump-perplexity-models
1873-feat-auto-add-and-watch-folder-for-document-uploads
1297-feat-gemini-agent-support
1759-bug-ui-bug-fixes
1686-feat-implement-winston-for-logging
1536-bug-toggling-on-users-can-delete-workspaces-does-not-take-effect
agent-ui-mobile-styles
1522-feat-chromadb-support
1595-bug-unable-to-get-live-web-search-and-browsing-agent-working-using-google-custom-search-engine-error-getaddrinfo-enotfound-http-errno-3008
1582-bug-lm-studio-does-not-allow-for-different-model-selection
1312-bug-usernames-should-not-be-case-sensitive-when-logging-in
1029-feat-hf-serverless-inference-api
1086-feat-implement-normalized-input-fields
knowledge-graph-support
644-bug-uploaded-file-name-does-not-match-the-displayed-file-name-after-the-upload
v1.15.0
v1.14.2
v1.14.1
v1.14.0
v1.13.0
v1.12.1
v1.12.0
v1.11.2
v1.11.1
v1.11.0
v1.10.0
v1.9.1
v1.9.0
v1.8.5
v1.8.4
v1.8.3
v1.8.2
v1.8.1
v1.8.0
v1.7.8
v1.7.6
v1.7.5
v1.7.4
v1.4.0
v1.3.0
v1.2.4
v1.2.3
v1.2.2
v1.2.1
v1.2.0
v1.1.1
v1.1.0
v1.0.0
Labels
Clear labels
Desktop
Docker
Integration Request
Integration Request
OS: Linux
OS: Mobile
OS: Windows
UI/UX
blocked
bug
bug
core-team-only
documentation
duplicate
embed-widget
enhancement
feature request
github_actions
good first issue
investigating
needs info / can't replicate
possible bug
pull-request
question
stage: specifications
wontfix
Mirrored from GitHub Pull Request
No Label
possible bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Notifications
Due Date
No due date set.
Dependencies
No dependencies set.
Reference: Mintplex-Labs/anything-llm#479
Reference in New Issue
Block a user
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @gabrie on GitHub (Feb 27, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/821
How are you running AnythingLLM?
AnythingLLM desktop app
What happened?
I'm using latest AnythingLLM Version 1.1.1 (1.1.1) on a M2 Mac Studio.
I tried to embed some PDF or TXT files with default LanceDB, fetch failed.
Then I get Chroma from github installed and ran locally with below command, NOT using Docker. Which is suggested by Chroma github.
Then I tested heartbeat, working.
Then I tried to embed same docs again, still failed. Since I tried with LanceDB getting same error from AnythingLLM, I guess I should report the bug here instead of Chroma. If it's a bug on Chroma, please excuse me. Not a tech guy.
Below finds running logs when error pops.
Running Chroma
Saving data to: /Volumes/Thunder_1T/chromaDB/
Connect to chroma at: http://localhost:8000
Getting started guide: https://docs.trychroma.com/getting-started
INFO: [27-02-2024 21:37:24] Set chroma_server_nofile to 65535
INFO: [27-02-2024 21:37:24] Anonymized telemetry enabled. See https://docs.trychroma.com/telemetry for more information.
DEBUG: [27-02-2024 21:37:24] Starting component System
DEBUG: [27-02-2024 21:37:24] Starting component OpenTelemetryClient
DEBUG: [27-02-2024 21:37:24] Starting component SimpleAssignmentPolicy
DEBUG: [27-02-2024 21:37:24] Starting component SqliteDB
DEBUG: [27-02-2024 21:37:24] Starting component QuotaEnforcer
DEBUG: [27-02-2024 21:37:24] Starting component Posthog
DEBUG: [27-02-2024 21:37:24] Starting component LocalSegmentManager
DEBUG: [27-02-2024 21:37:24] Starting component SegmentAPI
INFO: [27-02-2024 21:37:24] Started server process [3055]
INFO: [27-02-2024 21:37:24] Waiting for application startup.
INFO: [27-02-2024 21:37:24] Application startup complete.
INFO: [27-02-2024 21:37:24] Uvicorn running on http://localhost:8000 (Press CTRL+C to quit)
INFO: [27-02-2024 21:37:48] ::1:54252 - "GET /api/v1/heartbeat HTTP/1.1" 200
ERROR: [27-02-2024 21:37:48] Collection test does not exist.
Traceback (most recent call last):
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/anyio/streams/memory.py", line 97, in receive
return self.receive_nowait()
^^^^^^^^^^^^^^^^^^^^^
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/anyio/streams/memory.py", line 92, in receive_nowait
raise WouldBlock
anyio.WouldBlock
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/middleware/base.py", line 159, in call_next
message = await recv_stream.receive()
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/anyio/streams/memory.py", line 112, in receive
raise EndOfStream
anyio.EndOfStream
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/chromadb/server/fastapi/__init__.py", line 82, in catch_exceptions_middleware
return await call_next(request)
^^^^^^^^^^^^^^^^^^^^^^^^
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/middleware/base.py", line 165, in call_next
raise app_exc
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/middleware/base.py", line 151, in coro
await self.app(scope, receive_or_disconnect, send_no_error)
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/middleware/base.py", line 189, in call
with collapse_excgroups():
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/contextlib.py", line 155, in exit
self.gen.throw(value)
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/utils.py", line 93, in collapse_excgroups
raise exc
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/middleware/base.py", line 191, in call
response = await self.dispatch_func(request, call_next)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/chromadb/server/fastapi/__init_.py", line 96, in check_http_version_middleware
return await call_next(request)
^^^^^^^^^^^^^^^^^^^^^^^^
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/middleware/base.py", line 165, in call_next
raise app_exc
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/middleware/base.py", line 151, in coro
await self.app(scope, receive_or_disconnect, send_no_error)
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/middleware/exceptions.py", line 62, in call
await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
raise exc
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
await app(scope, receive, sender)
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/routing.py", line 758, in call
await self.middleware_stack(scope, receive, send)
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/routing.py", line 778, in app
await route.handle(scope, receive, send)
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/routing.py", line 299, in handle
await self.app(scope, receive, send)
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/routing.py", line 79, in app
await wrap_app_handling_exceptions(app, request)(scope, receive, send)
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
raise exc
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
await app(scope, receive, sender)
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/routing.py", line 74, in app
response = await func(request)
^^^^^^^^^^^^^^^^^^^
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/fastapi/routing.py", line 278, in app
raw_response = await run_endpoint_function(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/fastapi/routing.py", line 193, in run_endpoint_function
return await run_in_threadpool(dependant.call, **values)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/concurrency.py", line 42, in run_in_threadpool
return await anyio.to_thread.run_sync(func, *args)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/anyio/to_thread.py", line 56, in run_sync
return await get_async_backend().run_sync_in_worker_thread(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/anyio/_backends/_asyncio.py", line 2144, in run_sync_in_worker_thread
return await future
^^^^^^^^^^^^
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/anyio/_backends/asyncio.py", line 851, in run
result = context.run(func, *args)
^^^^^^^^^^^^^^^^^^^^^^^^
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/chromadb/telemetry/opentelemetry/__init__.py", line 127, in wrapper
return f(*args, **kwargs)
^^^^^^^^^^^^^^^^^^
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/chromadb/auth/fastapi.py", line 242, in wrapped
return f(*args, **kwargs)
^^^^^^^^^^^^^^^^^^
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/chromadb/server/fastapi/__init_.py", line 440, in get_collection
return self._api.get_collection(
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/chromadb/telemetry/opentelemetry/__init__.py", line 127, in wrapper
return f(*args, **kwargs)
^^^^^^^^^^^^^^^^^^
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/chromadb/api/segment.py", line 261, in get_collection
raise ValueError(f"Collection {name} does not exist.")
ValueError: Collection test does not exist.
INFO: [27-02-2024 21:37:48] ::1:54254 - "GET /api/v1/collections/test?tenant=default_tenant&database=default_database HTTP/1.1" 500
Are there known steps to reproduce?
Launch Chroma locally
Launch AnythingLLM
Set Vector DB to Chroma
Try to embed any docs in a workspace in AnythingLLM
@timothycarambat commented on GitHub (Feb 27, 2024):
Oddly enough, this is just because we are querying the vectors for a collection which does not exist. This should not exit the Chroma process though. Will look into it. Could be a bug with Chroma
@gabrie commented on GitHub (Feb 27, 2024):
Thanks a lot, it also appeared when I use LanceDB.
@timothycarambat commented on GitHub (Feb 27, 2024):
Did you get the fetch error when using LanceDB? That is local so there is no fetching at all. Did you get a different message?
@gabrie commented on GitHub (Feb 27, 2024):
I got same fetch failed error popup when using LanceDB.
Which happened at "save and embed" step
](url)
@timothycarambat commented on GitHub (Feb 27, 2024):
When you swapped your Vectordatabase you also clicked "save changes"? Can you screenshot that page as well? There are no external fetch requests when embedding documents with LanceDB to the DB. The only possible failure would be downloading the embedding model.
Can you additionally check
~/Library/Application Support/anythingllm-desktop/storage/modelsThere should be a folder called
Xenovawith a subfolder calledall-MiniLM-L6-v2.If it does not exist, that is the fetch failure and could be permissions or firewall related.
@gabrie commented on GitHub (Feb 27, 2024):
Sorry, I found ~/Library/Application Support/anythingllm-desktop/storage/models folder, inside there is NO
Xenovawith a subfolder calledall-MiniLM-L6-v2.I created them manually, tried again, still fetch failed. What should I do next?
@timothycarambat commented on GitHub (Feb 27, 2024):
hm, TLDR; you need to get this repo closed into the
models/Xenova/all-MiniLM-L6-v2folder https://huggingface.co/Xenova/all-MiniLM-L6-v2/tree/mainIn the past we have encountered this when HF is IP-blocking the user's IP either due to sanctions, abuse, VPN blocking or otherwise.
Looks like the primary way to avoid this is to pre-bundle the embedder with the app, which is not ideal. But that is the core issue. Alternatively, you can swap to another embedder like a local Ollama embedder, OpenAI, or otherwise.
That is the core issue though. Thank you for your help tracing this.
@gabrie commented on GitHub (Feb 28, 2024):
Fixed, thanks! Altough embedding all-MiniLM-L6-v2 model into the app bundle is not that ideal. But to be honest, comparing to other solutions such like privateGPT which needs users to know install from github/homebrew etc, I do feel AnythingLLM is much more smoother for regular users.
This is great for on-boarding, so maybe pre-bundle with the embedder is not a bad way. And all-MiniLM-L6-v2 is not so big at all.
@gabrie commented on GitHub (Feb 28, 2024):
Thanks a lot for swift reaction and help!
@timothycarambat commented on GitHub (Feb 28, 2024):
@gabrie If anything, we will at least host that model on our own CDN so that this critical piece is not missing. Really want to do everything we can to prevent bloating the app or adding models someone may not ever even use.
Closing as fixed. This issue has popped up some other places so I'm glad we got a fix. If you would like to comment how you downloaded and copy/pasted the folder from HF that would be appreciated as they do not have a "Download repo" button on their UI.
@gabrie commented on GitHub (Feb 28, 2024):
Steps to fix

1/ Go HF
2/ Download everything manually
3/ Copy all downloaded file into

~/Library/Application Support/anythingllm-desktop/storage/modelsAfter you finished, the folder should looks like below
4/ Go AnythingLLM, try embed a PDF, it should work.
@iandol commented on GitHub (Mar 7, 2024):
@timothycarambat -- thanks for the help! I am in China, and while my browser works as it uses a system proxy, probably ATLLM app ignores the system proxy (I know LM Studio also doesn't have proxy support and I download models manually there, while GPT4All does use the system proxy and connects to HF without issue).
I removed the ATLLM app, then reinstalled it (now V1.2.0) and manually downloaded the model - In
~/Library/Application SupportI hope no typos:Then restarted the app, but I get the same error. Starting from the console I see this error:
For some reason it didn't use the manually downloaded model and still tries to download.
@taozhiyuai commented on GitHub (Mar 7, 2024):
same as @iandol, download and save there. still not working
@timothycarambat commented on GitHub (Mar 8, 2024):
@iandol commented on GitHub (Mar 10, 2024):
The ... in my previous ss was just from my file manager, the name itself is the same as on HF.
@timothycarambat commented on GitHub (Mar 11, 2024):
🤔 , are the permissions on the file able to be accessed by the docker-container/user profile? they may be a different privilege level and that is why they are not found
@iandol commented on GitHub (Mar 11, 2024):
Permissions were 644. macOS can sometimes have annoying security restrictions, so I added the desktop app to "Full disk access" and removed all download metadata. Restart the app and this is now working for me. Thanks @timothycarambat for your patience... Let's hope proxy support in a future release will make this more robust.
@CheatingOP commented on GitHub (Mar 26, 2024):
@gabrie Didn't find ~/Library/Application Support/anythingllm-desktop/storage/models

@timothycarambat commented on GitHub (Mar 26, 2024):
@CheatingOP there is a storage folder in that image. Open that, create models folder if it does not exist, then follow the thread above
@watsonzh commented on GitHub (Mar 30, 2024):
@emulk commented on GitHub (Sep 22, 2024):
Hi, i'm having the same error,
but i'm running anythingllm as windows desktop application,
and i'm using ollama with llama3.1
I don't get how to solve it,
i have even trying on running ollama with a finetuned gguf model
{"level":"error","message":"Failed to vectorize fileDescription.txt","service":"backend"}
{"level":"info","message":"\u001b[32m[TELEMETRY SENT]\u001b[0m {"event":"documents_embedded_in_workspace","distinctId":"88654d0c-d7af-453e-8ce9-27f77e7f4706","properties":{"LLMSelection":"ollama","Embedder":"native","VectorDbSelection":"lancedb","TTSSelection":"native","runtime":"desktop"}}","service":"backend"}
{"level":"info","message":"\u001b[32m[Event Logged]\u001b[0m - workspace_documents_added","service":"backend"}
@timothycarambat commented on GitHub (Sep 23, 2024):
@emulk
The second solution on this document will help resolve your issues since you noted you are on Windows:
https://docs.anythingllm.com/fetch-failed-on-upload#windows-visual-c-redistributable
[BUG]: (fetch failed on embed) HuggingFace/Xenova blocking download from user IPto [GH-ISSUE #821] [BUG]: (fetch failed on embed) HuggingFace/Xenova blocking download from user IP