Mintplex-Labs/anything-llm
1
0
Fork 0
mirror of https://github.com/Mintplex-Labs/anything-llm.git synced 2026-07-19 14:13:35 -04:00
Code Issues 328 Packages Projects Releases 10 Wiki Activity

[GH-ISSUE #548] Failed to upload files in workspace with failed to embeed error #322

New Issue
Closed
opened 2026-02-22 18:18:56 -05:00 by yindo · 10 comments
yindo commented 2026-02-22 18:18:56 -05:00
Owner
Copy Link
Copy Source

Originally created by @stanltam on GitHub (Jan 5, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/548

LLM: ollama:latest
Embedding: AnythingLLM Embedder
Error Log:

[TELEMETRY SENT] {
event: 'documents_embedded_in_workspace',
distinctId: '4aea0721-0b3f-4014-81dd-d78c248f6b7d',
properties: {
LLMSelection: 'ollama',
Embedder: 'native',
VectorDbSelection: 'lancedb'
}
}
-- Working testing.pdf --
-- Parsing content from pg 1 --
-- Parsing content from pg 2 --
-- Parsing content from pg 3 --
-- Parsing content from pg 4 --
[SUCCESS]: testing.pdf converted & ready for embedding.

Document testing.pdf uploaded processed and successfully. It is now available in documents.
[TELEMETRY SENT] {
event: 'document_uploaded',
distinctId: '4aea0721-0b3f-4014-81dd-d78c248f6b7d',
properties: {}
}
Adding new vectorized document into namespace test
Chunks created from document: 11
[INFO] The native embedding model has never been run and will be downloaded right now. Subsequent runs will be faster. (~23MB)

Failed to load the native embedding model: TypeError: fetch failed
at Object.fetch (node:internal/deps/undici/undici:11730:11)
at processTicksAndRejections (node:internal/process/task_queues:95:5)
at runNextTicks (node:internal/process/task_queues:64:3)
at process.processImmediate (node:internal/timers:447:9)
at async getModelFile (file:///app/server/node_modules/@xenova/transformers/src/utils/hub.js:470:24)
at async getModelJSON (file:///app/server/node_modules/@xenova/transformers/src/utils/hub.js:574:18)
at async Promise.all (index 0)
at async loadTokenizer (file:///app/server/node_modules/@xenova/transformers/src/tokenizers.js:52:16)
at async AutoTokenizer.from_pretrained (file:///app/server/node_modules/@xenova/transformers/src/tokenizers.js:3920:48)
at async Promise.all (index 0) {
cause: ConnectTimeoutError: Connect Timeout Error
at onConnectTimeout (node:internal/deps/undici/undici:6869:28)
at node:internal/deps/undici/undici:6825:50
at Immediate._onImmediate (node:internal/deps/undici/undici:6857:13)
at process.processImmediate (node:internal/timers:476:21) {
code: 'UND_ERR_CONNECT_TIMEOUT'
}
}
TypeError: fetch failed
at Object.fetch (node:internal/deps/undici/undici:11730:11)
at processTicksAndRejections (node:internal/process/task_queues:95:5)
at runNextTicks (node:internal/process/task_queues:64:3)
at process.processImmediate (node:internal/timers:447:9)
at async getModelFile (file:///app/server/node_modules/@xenova/transformers/src/utils/hub.js:470:24)
at async getModelJSON (file:///app/server/node_modules/@xenova/transformers/src/utils/hub.js:574:18)
at async Promise.all (index 0)
at async loadTokenizer (file:///app/server/node_modules/@xenova/transformers/src/tokenizers.js:52:16)
at async AutoTokenizer.from_pretrained (file:///app/server/node_modules/@xenova/transformers/src/tokenizers.js:3920:48)
at async Promise.all (index 0) {
cause: ConnectTimeoutError: Connect Timeout Error
at onConnectTimeout (node:internal/deps/undici/undici:6869:28)
at node:internal/deps/undici/undici:6825:50
at Immediate._onImmediate (node:internal/deps/undici/undici:6857:13)
at process.processImmediate (node:internal/timers:476:21) {
code: 'UND_ERR_CONNECT_TIMEOUT'
}
}
addDocumentToNamespace fetch failed
Failed to vectorize custom-documents/testing.pdf-36edd41c-d784-454f-a885-a4b73a558ce7.json
[TELEMETRY SENT] {
event: 'documents_embedded_in_workspace',
distinctId: '4aea0721-0b3f-4014-81dd-d78c248f6b7d',
properties: {
LLMSelection: 'ollama',
Embedder: 'native',
VectorDbSelection: 'lancedb'
}
}

Originally created by @stanltam on GitHub (Jan 5, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/548 LLM: ollama:latest Embedding: AnythingLLM Embedder Error Log: [TELEMETRY SENT] { event: 'documents_embedded_in_workspace', distinctId: '4aea0721-0b3f-4014-81dd-d78c248f6b7d', properties: { LLMSelection: 'ollama', Embedder: 'native', VectorDbSelection: 'lancedb' } } -- Working testing.pdf -- -- Parsing content from pg 1 -- -- Parsing content from pg 2 -- -- Parsing content from pg 3 -- -- Parsing content from pg 4 -- [SUCCESS]: testing.pdf converted & ready for embedding. Document testing.pdf uploaded processed and successfully. It is now available in documents. [TELEMETRY SENT] { event: 'document_uploaded', distinctId: '4aea0721-0b3f-4014-81dd-d78c248f6b7d', properties: {} } Adding new vectorized document into namespace test Chunks created from document: 11 [INFO] The native embedding model has never been run and will be downloaded right now. Subsequent runs will be faster. (~23MB) Failed to load the native embedding model: TypeError: fetch failed at Object.fetch (node:internal/deps/undici/undici:11730:11) at processTicksAndRejections (node:internal/process/task_queues:95:5) at runNextTicks (node:internal/process/task_queues:64:3) at process.processImmediate (node:internal/timers:447:9) at async getModelFile (file:///app/server/node_modules/@xenova/transformers/src/utils/hub.js:470:24) at async getModelJSON (file:///app/server/node_modules/@xenova/transformers/src/utils/hub.js:574:18) at async Promise.all (index 0) at async loadTokenizer (file:///app/server/node_modules/@xenova/transformers/src/tokenizers.js:52:16) at async AutoTokenizer.from_pretrained (file:///app/server/node_modules/@xenova/transformers/src/tokenizers.js:3920:48) at async Promise.all (index 0) { cause: ConnectTimeoutError: Connect Timeout Error at onConnectTimeout (node:internal/deps/undici/undici:6869:28) at node:internal/deps/undici/undici:6825:50 at Immediate._onImmediate (node:internal/deps/undici/undici:6857:13) at process.processImmediate (node:internal/timers:476:21) { code: 'UND_ERR_CONNECT_TIMEOUT' } } TypeError: fetch failed at Object.fetch (node:internal/deps/undici/undici:11730:11) at processTicksAndRejections (node:internal/process/task_queues:95:5) at runNextTicks (node:internal/process/task_queues:64:3) at process.processImmediate (node:internal/timers:447:9) at async getModelFile (file:///app/server/node_modules/@xenova/transformers/src/utils/hub.js:470:24) at async getModelJSON (file:///app/server/node_modules/@xenova/transformers/src/utils/hub.js:574:18) at async Promise.all (index 0) at async loadTokenizer (file:///app/server/node_modules/@xenova/transformers/src/tokenizers.js:52:16) at async AutoTokenizer.from_pretrained (file:///app/server/node_modules/@xenova/transformers/src/tokenizers.js:3920:48) at async Promise.all (index 0) { cause: ConnectTimeoutError: Connect Timeout Error at onConnectTimeout (node:internal/deps/undici/undici:6869:28) at node:internal/deps/undici/undici:6825:50 at Immediate._onImmediate (node:internal/deps/undici/undici:6857:13) at process.processImmediate (node:internal/timers:476:21) { code: 'UND_ERR_CONNECT_TIMEOUT' } } addDocumentToNamespace fetch failed Failed to vectorize custom-documents/testing.pdf-36edd41c-d784-454f-a885-a4b73a558ce7.json [TELEMETRY SENT] { event: 'documents_embedded_in_workspace', distinctId: '4aea0721-0b3f-4014-81dd-d78c248f6b7d', properties: { LLMSelection: 'ollama', Embedder: 'native', VectorDbSelection: 'lancedb' } }
yindo added the Dockerpossible bug labels 2026-02-22 18:18:56 -05:00
yindo closed this issue 2026-02-22 18:18:56 -05:00
yindo commented 2026-02-22 18:18:57 -05:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (Jan 5, 2024):

@stanltam Are you running AnythingLLM in a docker container on a MacBook with an M-series chip?

@timothycarambat commented on GitHub (Jan 5, 2024): @stanltam Are you running AnythingLLM in a docker container on a MacBook with an M-series chip?
yindo commented 2026-02-22 18:18:57 -05:00
Author
Owner
Copy Link
Copy Source

@bioone commented on GitHub (Jan 5, 2024):

i'm the same error ,i run AnythingLLM in a docker container on a ubuntu system

@bioone commented on GitHub (Jan 5, 2024): i'm the same error ,i run AnythingLLM in a docker container on a ubuntu system
yindo commented 2026-02-22 18:18:57 -05:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (Jan 5, 2024):

@bioone This error is not AnythingLLM. Its a timeout on xenova/transformers downloading from huggingface. If you are having trouble embedding with the native embedder then you can swap to any other provider and re-embed documents.

Will look into if there is a way we can either pre-bake the native embedder into the image or increase the timeout

@timothycarambat commented on GitHub (Jan 5, 2024): @bioone This error is not AnythingLLM. Its a timeout on xenova/transformers downloading from huggingface. If you are having trouble embedding with the native embedder then you can swap to any other provider and re-embed documents. Will look into if there is a way we can either pre-bake the native embedder into the image or increase the timeout
yindo commented 2026-02-22 18:18:57 -05:00
Author
Owner
Copy Link
Copy Source

@bioone commented on GitHub (Jan 6, 2024):

@timothycarambat OK, I hope you can pre-bake the native embedder, it's very useful!!!

@bioone commented on GitHub (Jan 6, 2024): @timothycarambat OK, I hope you can pre-bake the native embedder, it's very useful!!!
yindo commented 2026-02-22 18:18:57 -05:00
Author
Owner
Copy Link
Copy Source

@Rainmanqxy commented on GitHub (Apr 2, 2024):

Hi there! Any updates on the issue? I still encounter the problem to embed PDF files in workspace (using LanceDB). I'm using LM Studio with Anything LLM...

@Rainmanqxy commented on GitHub (Apr 2, 2024): Hi there! Any updates on the issue? I still encounter the problem to embed PDF files in workspace (using LanceDB). I'm using LM Studio with Anything LLM...
yindo commented 2026-02-22 18:18:57 -05:00
Author
Owner
Copy Link
Copy Source

@warrior-dl commented on GitHub (Apr 3, 2024):

I deployed using Docker, but encountered an error when importing files, indicating a timeout.

[INFO] The native embedding model has never been run and will be downloaded right now. Subsequent runs will be faster. (~23MB)


Failed to load the native embedding model: TypeError: fetch failed
    at Object.fetch (node:internal/deps/undici/undici:11731:11)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async getModelFile (file:///app/server/node_modules/@xenova/transformers/src/utils/hub.js:471:24)
    at async getModelJSON (file:///app/server/node_modules/@xenova/transformers/src/utils/hub.js:575:18)
    at async Promise.all (index 0)
    at async loadTokenizer (file:///app/server/node_modules/@xenova/transformers/src/tokenizers.js:61:18)
    at async AutoTokenizer.from_pretrained (file:///app/server/node_modules/@xenova/transformers/src/tokenizers.js:4296:50)
    at async Promise.all (index 0)
    at async loadItems (file:///app/server/node_modules/@xenova/transformers/src/pipelines.js:3115:5)
    at async pipeline (file:///app/server/node_modules/@xenova/transformers/src/pipelines.js:3055:21) {
  cause: ConnectTimeoutError: Connect Timeout Error
      at onConnectTimeout (node:internal/deps/undici/undici:6869:28)
      at node:internal/deps/undici/undici:6825:50
      at Immediate._onImmediate (node:internal/deps/undici/undici:6857:13)
      at process.processImmediate (node:internal/timers:476:21) {
    code: 'UND_ERR_CONNECT_TIMEOUT'
  }
}
addDocumentToNamespace fetch failed
@warrior-dl commented on GitHub (Apr 3, 2024): I deployed using Docker, but encountered an error when importing files, indicating a timeout. ``` [INFO] The native embedding model has never been run and will be downloaded right now. Subsequent runs will be faster. (~23MB) Failed to load the native embedding model: TypeError: fetch failed at Object.fetch (node:internal/deps/undici/undici:11731:11) at process.processTicksAndRejections (node:internal/process/task_queues:95:5) at async getModelFile (file:///app/server/node_modules/@xenova/transformers/src/utils/hub.js:471:24) at async getModelJSON (file:///app/server/node_modules/@xenova/transformers/src/utils/hub.js:575:18) at async Promise.all (index 0) at async loadTokenizer (file:///app/server/node_modules/@xenova/transformers/src/tokenizers.js:61:18) at async AutoTokenizer.from_pretrained (file:///app/server/node_modules/@xenova/transformers/src/tokenizers.js:4296:50) at async Promise.all (index 0) at async loadItems (file:///app/server/node_modules/@xenova/transformers/src/pipelines.js:3115:5) at async pipeline (file:///app/server/node_modules/@xenova/transformers/src/pipelines.js:3055:21) { cause: ConnectTimeoutError: Connect Timeout Error at onConnectTimeout (node:internal/deps/undici/undici:6869:28) at node:internal/deps/undici/undici:6825:50 at Immediate._onImmediate (node:internal/deps/undici/undici:6857:13) at process.processImmediate (node:internal/timers:476:21) { code: 'UND_ERR_CONNECT_TIMEOUT' } } addDocumentToNamespace fetch failed ```
yindo commented 2026-02-22 18:18:57 -05:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (Apr 3, 2024):

@warrior-dl see pinned issue. HF is blocking your IP
https://github.com/Mintplex-Labs/anything-llm/issues/821

@timothycarambat commented on GitHub (Apr 3, 2024): @warrior-dl see pinned issue. HF is blocking your IP https://github.com/Mintplex-Labs/anything-llm/issues/821
yindo commented 2026-02-22 18:18:57 -05:00
Author
Owner
Copy Link
Copy Source

@warrior-dl commented on GitHub (Apr 3, 2024):

@warrior-dl see pinned issue. HF is blocking your IP #821

Thank you very much, I successfully imported the file after manually downloading the model.

@warrior-dl commented on GitHub (Apr 3, 2024): > @warrior-dl see pinned issue. HF is blocking your IP #821 Thank you very much, I successfully imported the file after manually downloading the model.
yindo commented 2026-02-22 18:18:57 -05:00
Author
Owner
Copy Link
Copy Source

@ZiHAO-LI-cmd commented on GitHub (Apr 9, 2024):

@warrior-dl Hi, could you please tell me how to manually download the embedding model? Where should the model be downloaded?

@ZiHAO-LI-cmd commented on GitHub (Apr 9, 2024): @warrior-dl Hi, could you please tell me how to manually download the embedding model? Where should the model be downloaded?
yindo commented 2026-02-22 18:18:57 -05:00
Author
Owner
Copy Link
Copy Source

@warrior-dl commented on GitHub (Apr 19, 2024):

@warrior-dl Hi, could you please tell me how to manually download the embedding model? Where should the model be downloaded?

https://github.com/Mintplex-Labs/anything-llm/issues/821#issuecomment-1968382359

@warrior-dl commented on GitHub (Apr 19, 2024): > @warrior-dl Hi, could you please tell me how to manually download the embedding model? Where should the model be downloaded? https://github.com/Mintplex-Labs/anything-llm/issues/821#issuecomment-1968382359
yindo changed title from Failed to upload files in workspace with failed to embeed error to [GH-ISSUE #548] Failed to upload files in workspace with failed to embeed error 2026-06-05 14:34:42 -04:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Desktop
Docker
Integration Request
Integration Request
OS: Linux
OS: Mobile
OS: Windows
UI/UX
blocked
bug
bug
core-team-only
documentation
duplicate
embed-widget
enhancement
feature request
github_actions
good first issue
investigating
needs info / can't replicate
possible bug
pull-request
Mirrored from GitHub Pull Request
 question
stage: specifications
wontfix
No Label Docker possible bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#322
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?