Mintplex-Labs/anything-llm
1
0
Fork 0
mirror of https://github.com/Mintplex-Labs/anything-llm.git synced 2026-07-19 14:13:35 -04:00
Code Issues 328 Packages Projects Releases 10 Wiki Activity

[GH-ISSUE #3962] [BUG]: Embedding timeout #2523

New Issue
Closed
opened 2026-02-22 18:30:03 -05:00 by yindo · 11 comments
yindo commented 2026-02-22 18:30:03 -05:00
Owner
Copy Link
Copy Source

Originally created by @alainlizotte on GitHub (Jun 6, 2025).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/3962

How are you running AnythingLLM?

Docker (local)

What happened?

When embedding files to my workspace, after about 3 minutes, I get an error message (Failed to execute "JSON" on"response"..) and the files window updates showing incomplete listing.

But I can hear that the CPU is still working. If I close et reopen the embedding window after a little while, I can see the complete file listing.

I don't know if everything gets embedded correctly.

Seems to be a kind of timeout when embedding large files (but largest is about 2 MB).

Image
Image

Using Milvus Vector Database and Ollama for embedding (BGE-M3).

Are there known steps to reproduce?

No response

Originally created by @alainlizotte on GitHub (Jun 6, 2025). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/3962 ### How are you running AnythingLLM? Docker (local) ### What happened? When embedding files to my workspace, after about 3 minutes, I get an error message (Failed to execute "JSON" on"response"..) and the files window updates showing incomplete listing. But I can hear that the CPU is still working. If I close et reopen the embedding window after a little while, I can see the complete file listing. I don't know if everything gets embedded correctly. Seems to be a kind of timeout when embedding large files (but largest is about 2 MB). ![Image](https://github.com/user-attachments/assets/27a79cf9-e101-4356-939e-949834466862) ![Image](https://github.com/user-attachments/assets/03bf9de3-83f2-4c3a-b315-582568d97c45) Using Milvus Vector Database and Ollama for embedding (BGE-M3). ### Are there known steps to reproduce? _No response_
yindo added the possible bugneeds info / can't replicate labels 2026-02-22 18:30:03 -05:00
yindo closed this issue 2026-02-22 18:30:03 -05:00
yindo commented 2026-02-22 18:30:03 -05:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (Jun 6, 2025):

Docker (local)

In this case, can you view your logs to see a more definitive log or error? An unexpected JSON output is very weird, which would seem to indicate a connection aborted. BGE-M3 is not a crazy large model but depending on the size and amount of embeddings, it is possible that either Ollama is getting OOM errors or something outside of AnythingLLM is going down.

Since we dont get a JSON response as completed, it would indicate that the external service is failing/crashing and not something in AnythingLLM, which would be out of our scope to resolve.

Also what are the specs of the computer, since Ollama is using those resources to do the embeddings?

@timothycarambat commented on GitHub (Jun 6, 2025): > Docker (local) In this case, can you view your logs to see a more definitive log or error? An unexpected JSON output is very weird, which would seem to indicate a connection aborted. BGE-M3 is not a crazy large model but depending on the _size and amount_ of embeddings, it is possible that either Ollama is getting OOM errors or something outside of AnythingLLM is going down. Since we dont get a JSON response as completed, it would indicate that the _external_ service is failing/crashing and not something in AnythingLLM, which would be out of our scope to resolve. Also what are the specs of the computer, since Ollama is using those resources to do the embeddings?
yindo commented 2026-02-22 18:30:03 -05:00
Author
Owner
Copy Link
Copy Source

@alainlizotte commented on GitHub (Jun 6, 2025):

@timothycarambat

Computer:
CPU: Intel 13600K
GPU: GeForce RTX 3060 Ti (8GB)
Ram: 32GB DDR4

@alainlizotte commented on GitHub (Jun 6, 2025): @timothycarambat Computer: CPU: Intel 13600K GPU: GeForce RTX 3060 Ti (8GB) Ram: 32GB DDR4
yindo commented 2026-02-22 18:30:03 -05:00
Author
Owner
Copy Link
Copy Source

@alainlizotte commented on GitHub (Jun 6, 2025):

@timothycarambat

Here is the log in Docker. The error in AnythingLLM is appening during the line ([backend] info: [OllamaEmbedder] Embedding 962 chunks of text with bge-m3:latest.)

This log was started juste before re-embedding my files.

2025-06-06 17:20:41.878 | [backend] info: Adding new vectorized document into namespace cnesst
2025-06-06 17:20:41.878 | [backend] info: [OllamaEmbedder] initialized with model bge-m3:latest at http://172.17.0.1:11434. num_ctx: 600
2025-06-06 17:20:41.882 | [backend] info: [RecursiveSplitter] Will split with {"chunkSize":600,"chunkOverlap":100}
2025-06-06 17:20:41.884 | [backend] info: Chunks created from document: 65
2025-06-06 17:20:41.886 | [backend] info: [OllamaEmbedder] Embedding 65 chunks of text with bge-m3:latest.
2025-06-06 17:20:48.294 | [backend] info: Inserting vectorized chunks into Milvus.
2025-06-06 17:20:48.346 | [backend] info: Caching vectorized results of SST/CCHST-Enquete-sur-les-incidents.pdf-d516fe87-36af-47a5-8c97-c737584f6a38.json to prevent duplicated embedding.
2025-06-06 17:20:51.352 | [backend] info: Adding new vectorized document into namespace cnesst
2025-06-06 17:20:51.352 | [backend] info: [OllamaEmbedder] initialized with model bge-m3:latest at http://172.17.0.1:11434. num_ctx: 600
2025-06-06 17:20:51.355 | [backend] info: [RecursiveSplitter] Will split with {"chunkSize":600,"chunkOverlap":100}
2025-06-06 17:20:51.356 | [backend] info: Chunks created from document: 28
2025-06-06 17:20:51.357 | [backend] info: [OllamaEmbedder] Embedding 28 chunks of text with bge-m3:latest.
2025-06-06 17:20:53.015 | [backend] info: Inserting vectorized chunks into Milvus.
2025-06-06 17:20:53.039 | [backend] info: Caching vectorized results of SST/CCHST-diligence-raisonnable.pdf-63d6d682-204e-49a3-8fc4-b11090b1d6fb.json to prevent duplicated embedding.
2025-06-06 17:20:53.302 | [backend] info: Adding new vectorized document into namespace cnesst
2025-06-06 17:20:53.302 | [backend] info: [OllamaEmbedder] initialized with model bge-m3:latest at http://172.17.0.1:11434. num_ctx: 600
2025-06-06 17:20:53.305 | [backend] info: [RecursiveSplitter] Will split with {"chunkSize":600,"chunkOverlap":100}
2025-06-06 17:20:53.310 | [backend] info: Chunks created from document: 417
2025-06-06 17:20:53.312 | [backend] info: [OllamaEmbedder] Embedding 417 chunks of text with bge-m3:latest.
2025-06-06 17:21:13.604 | [backend] info: Inserting vectorized chunks into Milvus.
2025-06-06 17:21:13.869 | [backend] info: Caching vectorized results of SST/LOI-SUR-LA-SANTE-ET-LA-SECURITE-DU-TRAVAIL.pdf-73ea42eb-8a6f-4643-ad49-6f6f73f8b852.json to prevent duplicated embedding.
2025-06-06 17:21:16.820 | [backend] info: Adding new vectorized document into namespace cnesst
2025-06-06 17:21:16.820 | [backend] info: [OllamaEmbedder] initialized with model bge-m3:latest at http://172.17.0.1:11434. num_ctx: 600
2025-06-06 17:21:16.823 | [backend] info: [RecursiveSplitter] Will split with {"chunkSize":600,"chunkOverlap":100}
2025-06-06 17:21:16.837 | [backend] info: Chunks created from document: 745
2025-06-06 17:21:16.840 | [backend] info: [OllamaEmbedder] Embedding 745 chunks of text with bge-m3:latest.
2025-06-06 17:21:54.163 | [backend] info: Inserting vectorized chunks into Milvus.
2025-06-06 17:21:54.604 | [backend] info: Caching vectorized results of SST/LOI-SUR-LES-ACCIDENTS-DU-TRAVAIL-ET-LES-MALADIES-PROFESSIONNELLES.pdf-cd060df8-c930-4aa2-b9fb-9556ab14b6d0.json to prevent duplicated embedding.
2025-06-06 17:21:57.363 | [backend] info: Adding new vectorized document into namespace cnesst
2025-06-06 17:21:57.363 | [backend] info: [OllamaEmbedder] initialized with model bge-m3:latest at http://172.17.0.1:11434. num_ctx: 600
2025-06-06 17:21:57.368 | [backend] info: [RecursiveSplitter] Will split with {"chunkSize":600,"chunkOverlap":100}
2025-06-06 17:21:57.369 | [backend] info: Chunks created from document: 88
2025-06-06 17:21:57.369 | [backend] info: [OllamaEmbedder] Embedding 88 chunks of text with bge-m3:latest.
2025-06-06 17:22:01.661 | [backend] info: Inserting vectorized chunks into Milvus.
2025-06-06 17:22:01.719 | [backend] info: Caching vectorized results of SST/Reglement-sur-l'information-concernant-les-produits-dangereux.pdf-b0992391-8865-4900-bf28-ee65aa4ea74a.json to prevent duplicated embedding.
2025-06-06 17:22:02.241 | [backend] info: Adding new vectorized document into namespace cnesst
2025-06-06 17:22:02.241 | [backend] info: [OllamaEmbedder] initialized with model bge-m3:latest at http://172.17.0.1:11434. num_ctx: 600
2025-06-06 17:22:02.245 | [backend] info: [RecursiveSplitter] Will split with {"chunkSize":600,"chunkOverlap":100}
2025-06-06 17:22:02.261 | [backend] info: Chunks created from document: 962
2025-06-06 17:22:02.262 | [backend] info: [OllamaEmbedder] Embedding 962 chunks of text with bge-m3:latest.
2025-06-06 17:22:49.264 | [backend] info: Inserting vectorized chunks into Milvus.
2025-06-06 17:22:49.765 | [backend] info: Caching vectorized results of SST/Reglement-sur-la-sante-et-la-securite-du-travail.pdf-8c7dac6e-eb8a-4929-a858-8394043e6c13.json to prevent duplicated embedding.
2025-06-06 17:22:52.798 | [backend] info: Adding new vectorized document into namespace cnesst
2025-06-06 17:22:52.798 | [backend] info: [OllamaEmbedder] initialized with model bge-m3:latest at http://172.17.0.1:11434. num_ctx: 600
2025-06-06 17:22:52.801 | [backend] info: [RecursiveSplitter] Will split with {"chunkSize":600,"chunkOverlap":100}
2025-06-06 17:22:52.802 | [backend] info: Chunks created from document: 94
2025-06-06 17:22:52.804 | [backend] info: [OllamaEmbedder] Embedding 94 chunks of text with bge-m3:latest.
2025-06-06 17:22:57.581 | [backend] info: Inserting vectorized chunks into Milvus.
2025-06-06 17:22:57.663 | [backend] info: Caching vectorized results of SST/Reglement-sur-le-representant-a-la-prevention-dans-un-etablissement.pdf-4f9bf33a-80cb-435c-82d1-c7f3d94d407c.json to prevent duplicated embedding.
2025-06-06 17:22:58.167 | [backend] info: Adding new vectorized document into namespace cnesst
2025-06-06 17:22:58.167 | [backend] info: [OllamaEmbedder] initialized with model bge-m3:latest at http://172.17.0.1:11434. num_ctx: 600
2025-06-06 17:22:58.170 | [backend] info: [RecursiveSplitter] Will split with {"chunkSize":600,"chunkOverlap":100}
2025-06-06 17:22:58.171 | [backend] info: Chunks created from document: 111
2025-06-06 17:22:58.172 | [backend] info: [OllamaEmbedder] Embedding 111 chunks of text with bge-m3:latest.
2025-06-06 17:23:03.544 | [backend] info: Inserting vectorized chunks into Milvus.
2025-06-06 17:23:03.629 | [backend] info: Caching vectorized results of SST/Reglement-sur-les-comites-de-sante-et-de-securite-du-travail.pdf-d7399501-3998-40b1-b186-0e8e3e05c4e1.json to prevent duplicated embedding.
2025-06-06 17:23:06.711 | [backend] info: Adding new vectorized document into namespace cnesst
2025-06-06 17:23:06.712 | [backend] info: [OllamaEmbedder] initialized with model bge-m3:latest at http://172.17.0.1:11434. num_ctx: 600
2025-06-06 17:23:06.715 | [backend] info: [RecursiveSplitter] Will split with {"chunkSize":600,"chunkOverlap":100}
2025-06-06 17:23:06.715 | [backend] info: Chunks created from document: 24
2025-06-06 17:23:06.716 | [backend] info: [OllamaEmbedder] Embedding 24 chunks of text with bge-m3:latest.
2025-06-06 17:23:07.931 | [backend] info: Inserting vectorized chunks into Milvus.
2025-06-06 17:23:07.955 | [backend] info: Caching vectorized results of SST/Roles-et-fonctions-du-representant-a-la-prevention.docx-15989f9e-c54e-42c0-88eb-5a2a37d1d7d6.json to prevent duplicated embedding.
2025-06-06 17:23:08.196 | [backend] info: Adding new vectorized document into namespace cnesst
2025-06-06 17:23:08.196 | [backend] info: [OllamaEmbedder] initialized with model bge-m3:latest at http://172.17.0.1:11434. num_ctx: 600
2025-06-06 17:23:08.199 | [backend] info: [RecursiveSplitter] Will split with {"chunkSize":600,"chunkOverlap":100}
2025-06-06 17:23:08.199 | [backend] info: Chunks created from document: 11
2025-06-06 17:23:08.200 | [backend] info: [OllamaEmbedder] Embedding 11 chunks of text with bge-m3:latest.
2025-06-06 17:23:08.697 | [backend] info: Inserting vectorized chunks into Milvus.
2025-06-06 17:23:08.707 | [backend] info: Caching vectorized results of SST/accident-travail.docx-6d294a85-916d-4045-aa82-58fb04b5eaab.json to prevent duplicated embedding.
2025-06-06 17:23:08.887 | [backend] info: Adding new vectorized document into namespace cnesst
2025-06-06 17:23:08.887 | [backend] info: [OllamaEmbedder] initialized with model bge-m3:latest at http://172.17.0.1:11434. num_ctx: 600
2025-06-06 17:23:08.891 | [backend] info: [RecursiveSplitter] Will split with {"chunkSize":600,"chunkOverlap":100}
2025-06-06 17:23:08.891 | [backend] info: Chunks created from document: 5
2025-06-06 17:23:08.892 | [backend] info: [OllamaEmbedder] Embedding 5 chunks of text with bge-m3:latest.
2025-06-06 17:23:09.156 | [backend] info: Inserting vectorized chunks into Milvus.
2025-06-06 17:23:09.174 | [backend] info: Caching vectorized results of SST/droit-de-refus.docx-7fe94752-f1a5-4e3d-9522-fc97340c1a7d.json to prevent duplicated embedding.
2025-06-06 17:23:09.329 | [backend] info: Adding new vectorized document into namespace cnesst
2025-06-06 17:23:09.329 | [backend] info: [OllamaEmbedder] initialized with model bge-m3:latest at http://172.17.0.1:11434. num_ctx: 600
2025-06-06 17:23:09.332 | [backend] info: [RecursiveSplitter] Will split with {"chunkSize":600,"chunkOverlap":100}
2025-06-06 17:23:09.332 | [backend] info: Chunks created from document: 5
2025-06-06 17:23:09.333 | [backend] info: [OllamaEmbedder] Embedding 5 chunks of text with bge-m3:latest.
2025-06-06 17:23:09.610 | [backend] info: Inserting vectorized chunks into Milvus.
2025-06-06 17:23:09.632 | [backend] info: Caching vectorized results of SST/enquete.docx-c1e6e0e3-1658-48a2-9589-dcbb22efb1f2.json to prevent duplicated embedding.
2025-06-06 17:23:09.802 | [backend] info: Adding new vectorized document into namespace cnesst
2025-06-06 17:23:09.802 | [backend] info: [OllamaEmbedder] initialized with model bge-m3:latest at http://172.17.0.1:11434. num_ctx: 600
2025-06-06 17:23:09.806 | [backend] info: [RecursiveSplitter] Will split with {"chunkSize":600,"chunkOverlap":100}
2025-06-06 17:23:09.806 | [backend] info: Chunks created from document: 11
2025-06-06 17:23:09.807 | [backend] info: [OllamaEmbedder] Embedding 11 chunks of text with bge-m3:latest.
2025-06-06 17:23:10.345 | [backend] info: Inserting vectorized chunks into Milvus.
2025-06-06 17:23:10.355 | [backend] info: Caching vectorized results of SST/formation.docx-734dc5da-1210-4ce0-868d-125d4753d93f.json to prevent duplicated embedding.
2025-06-06 17:23:10.545 | [backend] info: Adding new vectorized document into namespace cnesst
2025-06-06 17:23:10.545 | [backend] info: [OllamaEmbedder] initialized with model bge-m3:latest at http://172.17.0.1:11434. num_ctx: 600
2025-06-06 17:23:10.548 | [backend] info: [RecursiveSplitter] Will split with {"chunkSize":600,"chunkOverlap":100}
2025-06-06 17:23:10.548 | [backend] info: Chunks created from document: 9
2025-06-06 17:23:10.549 | [backend] info: [OllamaEmbedder] Embedding 9 chunks of text with bge-m3:latest.
2025-06-06 17:23:10.988 | [backend] info: Inserting vectorized chunks into Milvus.
2025-06-06 17:23:10.999 | [backend] info: Caching vectorized results of SST/harcelement.docx-987de628-bced-4eba-83fa-a4944d31a9cd.json to prevent duplicated embedding.
2025-06-06 17:23:11.172 | [backend] info: Adding new vectorized document into namespace cnesst
2025-06-06 17:23:11.172 | [backend] info: [OllamaEmbedder] initialized with model bge-m3:latest at http://172.17.0.1:11434. num_ctx: 600
2025-06-06 17:23:11.174 | [backend] info: [RecursiveSplitter] Will split with {"chunkSize":600,"chunkOverlap":100}
2025-06-06 17:23:11.174 | [backend] info: Chunks created from document: 13
2025-06-06 17:23:11.175 | [backend] info: [OllamaEmbedder] Embedding 13 chunks of text with bge-m3:latest.
2025-06-06 17:23:11.775 | [backend] info: Inserting vectorized chunks into Milvus.
2025-06-06 17:23:11.794 | [backend] info: Caching vectorized results of SST/multiprevention-diligence-raisonnable.pdf-907950bb-1542-4157-b4ba-1a04b134c555.json to prevent duplicated embedding.
2025-06-06 17:23:11.981 | [backend] info: Adding new vectorized document into namespace cnesst
2025-06-06 17:23:11.981 | [backend] info: [OllamaEmbedder] initialized with model bge-m3:latest at http://172.17.0.1:11434. num_ctx: 600
2025-06-06 17:23:11.984 | [backend] info: [RecursiveSplitter] Will split with {"chunkSize":600,"chunkOverlap":100}
2025-06-06 17:23:11.984 | [backend] info: Chunks created from document: 10
2025-06-06 17:23:11.985 | [backend] info: [OllamaEmbedder] Embedding 10 chunks of text with bge-m3:latest.
2025-06-06 17:23:12.448 | [backend] info: Inserting vectorized chunks into Milvus.
2025-06-06 17:23:12.471 | [backend] info: Caching vectorized results of SST/quoi-faire-harcelement.docx-ba1526d1-6a1f-432c-b7a2-4f2d7992d7f9.json to prevent duplicated embedding.
2025-06-06 17:23:12.643 | [backend] info: [TELEMETRY SENT] {"event":"documents_embedded_in_workspace","distinctId":"1ce1fa87-f54c-4208-a020-750c6d6ec7b6","properties":{"LLMSelection":"ollama","Embedder":"ollama","VectorDbSelection":"milvus","TTSSelection":"native","LLMModel":"qwen3:8b-q4_K_M","runtime":"docker"}}
2025-06-06 17:23:12.659 | [backend] info: [Event Logged] - workspace_documents_added

@alainlizotte commented on GitHub (Jun 6, 2025): @timothycarambat Here is the log in Docker. The error in AnythingLLM is appening during the line ([backend] info: [OllamaEmbedder] Embedding 962 chunks of text with bge-m3:latest.) This log was started juste before re-embedding my files. 2025-06-06 17:20:41.878 | [backend] info: Adding new vectorized document into namespace cnesst 2025-06-06 17:20:41.878 | [backend] info: [OllamaEmbedder] initialized with model bge-m3:latest at http://172.17.0.1:11434. num_ctx: 600 2025-06-06 17:20:41.882 | [backend] info: [RecursiveSplitter] Will split with {"chunkSize":600,"chunkOverlap":100} 2025-06-06 17:20:41.884 | [backend] info: Chunks created from document: 65 2025-06-06 17:20:41.886 | [backend] info: [OllamaEmbedder] Embedding 65 chunks of text with bge-m3:latest. 2025-06-06 17:20:48.294 | [backend] info: Inserting vectorized chunks into Milvus. 2025-06-06 17:20:48.346 | [backend] info: Caching vectorized results of SST/CCHST-Enquete-sur-les-incidents.pdf-d516fe87-36af-47a5-8c97-c737584f6a38.json to prevent duplicated embedding. 2025-06-06 17:20:51.352 | [backend] info: Adding new vectorized document into namespace cnesst 2025-06-06 17:20:51.352 | [backend] info: [OllamaEmbedder] initialized with model bge-m3:latest at http://172.17.0.1:11434. num_ctx: 600 2025-06-06 17:20:51.355 | [backend] info: [RecursiveSplitter] Will split with {"chunkSize":600,"chunkOverlap":100} 2025-06-06 17:20:51.356 | [backend] info: Chunks created from document: 28 2025-06-06 17:20:51.357 | [backend] info: [OllamaEmbedder] Embedding 28 chunks of text with bge-m3:latest. 2025-06-06 17:20:53.015 | [backend] info: Inserting vectorized chunks into Milvus. 2025-06-06 17:20:53.039 | [backend] info: Caching vectorized results of SST/CCHST-diligence-raisonnable.pdf-63d6d682-204e-49a3-8fc4-b11090b1d6fb.json to prevent duplicated embedding. 2025-06-06 17:20:53.302 | [backend] info: Adding new vectorized document into namespace cnesst 2025-06-06 17:20:53.302 | [backend] info: [OllamaEmbedder] initialized with model bge-m3:latest at http://172.17.0.1:11434. num_ctx: 600 2025-06-06 17:20:53.305 | [backend] info: [RecursiveSplitter] Will split with {"chunkSize":600,"chunkOverlap":100} 2025-06-06 17:20:53.310 | [backend] info: Chunks created from document: 417 2025-06-06 17:20:53.312 | [backend] info: [OllamaEmbedder] Embedding 417 chunks of text with bge-m3:latest. 2025-06-06 17:21:13.604 | [backend] info: Inserting vectorized chunks into Milvus. 2025-06-06 17:21:13.869 | [backend] info: Caching vectorized results of SST/LOI-SUR-LA-SANTE-ET-LA-SECURITE-DU-TRAVAIL.pdf-73ea42eb-8a6f-4643-ad49-6f6f73f8b852.json to prevent duplicated embedding. 2025-06-06 17:21:16.820 | [backend] info: Adding new vectorized document into namespace cnesst 2025-06-06 17:21:16.820 | [backend] info: [OllamaEmbedder] initialized with model bge-m3:latest at http://172.17.0.1:11434. num_ctx: 600 2025-06-06 17:21:16.823 | [backend] info: [RecursiveSplitter] Will split with {"chunkSize":600,"chunkOverlap":100} 2025-06-06 17:21:16.837 | [backend] info: Chunks created from document: 745 2025-06-06 17:21:16.840 | [backend] info: [OllamaEmbedder] Embedding 745 chunks of text with bge-m3:latest. 2025-06-06 17:21:54.163 | [backend] info: Inserting vectorized chunks into Milvus. 2025-06-06 17:21:54.604 | [backend] info: Caching vectorized results of SST/LOI-SUR-LES-ACCIDENTS-DU-TRAVAIL-ET-LES-MALADIES-PROFESSIONNELLES.pdf-cd060df8-c930-4aa2-b9fb-9556ab14b6d0.json to prevent duplicated embedding. 2025-06-06 17:21:57.363 | [backend] info: Adding new vectorized document into namespace cnesst 2025-06-06 17:21:57.363 | [backend] info: [OllamaEmbedder] initialized with model bge-m3:latest at http://172.17.0.1:11434. num_ctx: 600 2025-06-06 17:21:57.368 | [backend] info: [RecursiveSplitter] Will split with {"chunkSize":600,"chunkOverlap":100} 2025-06-06 17:21:57.369 | [backend] info: Chunks created from document: 88 2025-06-06 17:21:57.369 | [backend] info: [OllamaEmbedder] Embedding 88 chunks of text with bge-m3:latest. 2025-06-06 17:22:01.661 | [backend] info: Inserting vectorized chunks into Milvus. 2025-06-06 17:22:01.719 | [backend] info: Caching vectorized results of SST/Reglement-sur-l'information-concernant-les-produits-dangereux.pdf-b0992391-8865-4900-bf28-ee65aa4ea74a.json to prevent duplicated embedding. 2025-06-06 17:22:02.241 | [backend] info: Adding new vectorized document into namespace cnesst 2025-06-06 17:22:02.241 | [backend] info: [OllamaEmbedder] initialized with model bge-m3:latest at http://172.17.0.1:11434. num_ctx: 600 2025-06-06 17:22:02.245 | [backend] info: [RecursiveSplitter] Will split with {"chunkSize":600,"chunkOverlap":100} 2025-06-06 17:22:02.261 | [backend] info: Chunks created from document: 962 2025-06-06 17:22:02.262 | [backend] info: [OllamaEmbedder] Embedding 962 chunks of text with bge-m3:latest. 2025-06-06 17:22:49.264 | [backend] info: Inserting vectorized chunks into Milvus. 2025-06-06 17:22:49.765 | [backend] info: Caching vectorized results of SST/Reglement-sur-la-sante-et-la-securite-du-travail.pdf-8c7dac6e-eb8a-4929-a858-8394043e6c13.json to prevent duplicated embedding. 2025-06-06 17:22:52.798 | [backend] info: Adding new vectorized document into namespace cnesst 2025-06-06 17:22:52.798 | [backend] info: [OllamaEmbedder] initialized with model bge-m3:latest at http://172.17.0.1:11434. num_ctx: 600 2025-06-06 17:22:52.801 | [backend] info: [RecursiveSplitter] Will split with {"chunkSize":600,"chunkOverlap":100} 2025-06-06 17:22:52.802 | [backend] info: Chunks created from document: 94 2025-06-06 17:22:52.804 | [backend] info: [OllamaEmbedder] Embedding 94 chunks of text with bge-m3:latest. 2025-06-06 17:22:57.581 | [backend] info: Inserting vectorized chunks into Milvus. 2025-06-06 17:22:57.663 | [backend] info: Caching vectorized results of SST/Reglement-sur-le-representant-a-la-prevention-dans-un-etablissement.pdf-4f9bf33a-80cb-435c-82d1-c7f3d94d407c.json to prevent duplicated embedding. 2025-06-06 17:22:58.167 | [backend] info: Adding new vectorized document into namespace cnesst 2025-06-06 17:22:58.167 | [backend] info: [OllamaEmbedder] initialized with model bge-m3:latest at http://172.17.0.1:11434. num_ctx: 600 2025-06-06 17:22:58.170 | [backend] info: [RecursiveSplitter] Will split with {"chunkSize":600,"chunkOverlap":100} 2025-06-06 17:22:58.171 | [backend] info: Chunks created from document: 111 2025-06-06 17:22:58.172 | [backend] info: [OllamaEmbedder] Embedding 111 chunks of text with bge-m3:latest. 2025-06-06 17:23:03.544 | [backend] info: Inserting vectorized chunks into Milvus. 2025-06-06 17:23:03.629 | [backend] info: Caching vectorized results of SST/Reglement-sur-les-comites-de-sante-et-de-securite-du-travail.pdf-d7399501-3998-40b1-b186-0e8e3e05c4e1.json to prevent duplicated embedding. 2025-06-06 17:23:06.711 | [backend] info: Adding new vectorized document into namespace cnesst 2025-06-06 17:23:06.712 | [backend] info: [OllamaEmbedder] initialized with model bge-m3:latest at http://172.17.0.1:11434. num_ctx: 600 2025-06-06 17:23:06.715 | [backend] info: [RecursiveSplitter] Will split with {"chunkSize":600,"chunkOverlap":100} 2025-06-06 17:23:06.715 | [backend] info: Chunks created from document: 24 2025-06-06 17:23:06.716 | [backend] info: [OllamaEmbedder] Embedding 24 chunks of text with bge-m3:latest. 2025-06-06 17:23:07.931 | [backend] info: Inserting vectorized chunks into Milvus. 2025-06-06 17:23:07.955 | [backend] info: Caching vectorized results of SST/Roles-et-fonctions-du-representant-a-la-prevention.docx-15989f9e-c54e-42c0-88eb-5a2a37d1d7d6.json to prevent duplicated embedding. 2025-06-06 17:23:08.196 | [backend] info: Adding new vectorized document into namespace cnesst 2025-06-06 17:23:08.196 | [backend] info: [OllamaEmbedder] initialized with model bge-m3:latest at http://172.17.0.1:11434. num_ctx: 600 2025-06-06 17:23:08.199 | [backend] info: [RecursiveSplitter] Will split with {"chunkSize":600,"chunkOverlap":100} 2025-06-06 17:23:08.199 | [backend] info: Chunks created from document: 11 2025-06-06 17:23:08.200 | [backend] info: [OllamaEmbedder] Embedding 11 chunks of text with bge-m3:latest. 2025-06-06 17:23:08.697 | [backend] info: Inserting vectorized chunks into Milvus. 2025-06-06 17:23:08.707 | [backend] info: Caching vectorized results of SST/accident-travail.docx-6d294a85-916d-4045-aa82-58fb04b5eaab.json to prevent duplicated embedding. 2025-06-06 17:23:08.887 | [backend] info: Adding new vectorized document into namespace cnesst 2025-06-06 17:23:08.887 | [backend] info: [OllamaEmbedder] initialized with model bge-m3:latest at http://172.17.0.1:11434. num_ctx: 600 2025-06-06 17:23:08.891 | [backend] info: [RecursiveSplitter] Will split with {"chunkSize":600,"chunkOverlap":100} 2025-06-06 17:23:08.891 | [backend] info: Chunks created from document: 5 2025-06-06 17:23:08.892 | [backend] info: [OllamaEmbedder] Embedding 5 chunks of text with bge-m3:latest. 2025-06-06 17:23:09.156 | [backend] info: Inserting vectorized chunks into Milvus. 2025-06-06 17:23:09.174 | [backend] info: Caching vectorized results of SST/droit-de-refus.docx-7fe94752-f1a5-4e3d-9522-fc97340c1a7d.json to prevent duplicated embedding. 2025-06-06 17:23:09.329 | [backend] info: Adding new vectorized document into namespace cnesst 2025-06-06 17:23:09.329 | [backend] info: [OllamaEmbedder] initialized with model bge-m3:latest at http://172.17.0.1:11434. num_ctx: 600 2025-06-06 17:23:09.332 | [backend] info: [RecursiveSplitter] Will split with {"chunkSize":600,"chunkOverlap":100} 2025-06-06 17:23:09.332 | [backend] info: Chunks created from document: 5 2025-06-06 17:23:09.333 | [backend] info: [OllamaEmbedder] Embedding 5 chunks of text with bge-m3:latest. 2025-06-06 17:23:09.610 | [backend] info: Inserting vectorized chunks into Milvus. 2025-06-06 17:23:09.632 | [backend] info: Caching vectorized results of SST/enquete.docx-c1e6e0e3-1658-48a2-9589-dcbb22efb1f2.json to prevent duplicated embedding. 2025-06-06 17:23:09.802 | [backend] info: Adding new vectorized document into namespace cnesst 2025-06-06 17:23:09.802 | [backend] info: [OllamaEmbedder] initialized with model bge-m3:latest at http://172.17.0.1:11434. num_ctx: 600 2025-06-06 17:23:09.806 | [backend] info: [RecursiveSplitter] Will split with {"chunkSize":600,"chunkOverlap":100} 2025-06-06 17:23:09.806 | [backend] info: Chunks created from document: 11 2025-06-06 17:23:09.807 | [backend] info: [OllamaEmbedder] Embedding 11 chunks of text with bge-m3:latest. 2025-06-06 17:23:10.345 | [backend] info: Inserting vectorized chunks into Milvus. 2025-06-06 17:23:10.355 | [backend] info: Caching vectorized results of SST/formation.docx-734dc5da-1210-4ce0-868d-125d4753d93f.json to prevent duplicated embedding. 2025-06-06 17:23:10.545 | [backend] info: Adding new vectorized document into namespace cnesst 2025-06-06 17:23:10.545 | [backend] info: [OllamaEmbedder] initialized with model bge-m3:latest at http://172.17.0.1:11434. num_ctx: 600 2025-06-06 17:23:10.548 | [backend] info: [RecursiveSplitter] Will split with {"chunkSize":600,"chunkOverlap":100} 2025-06-06 17:23:10.548 | [backend] info: Chunks created from document: 9 2025-06-06 17:23:10.549 | [backend] info: [OllamaEmbedder] Embedding 9 chunks of text with bge-m3:latest. 2025-06-06 17:23:10.988 | [backend] info: Inserting vectorized chunks into Milvus. 2025-06-06 17:23:10.999 | [backend] info: Caching vectorized results of SST/harcelement.docx-987de628-bced-4eba-83fa-a4944d31a9cd.json to prevent duplicated embedding. 2025-06-06 17:23:11.172 | [backend] info: Adding new vectorized document into namespace cnesst 2025-06-06 17:23:11.172 | [backend] info: [OllamaEmbedder] initialized with model bge-m3:latest at http://172.17.0.1:11434. num_ctx: 600 2025-06-06 17:23:11.174 | [backend] info: [RecursiveSplitter] Will split with {"chunkSize":600,"chunkOverlap":100} 2025-06-06 17:23:11.174 | [backend] info: Chunks created from document: 13 2025-06-06 17:23:11.175 | [backend] info: [OllamaEmbedder] Embedding 13 chunks of text with bge-m3:latest. 2025-06-06 17:23:11.775 | [backend] info: Inserting vectorized chunks into Milvus. 2025-06-06 17:23:11.794 | [backend] info: Caching vectorized results of SST/multiprevention-diligence-raisonnable.pdf-907950bb-1542-4157-b4ba-1a04b134c555.json to prevent duplicated embedding. 2025-06-06 17:23:11.981 | [backend] info: Adding new vectorized document into namespace cnesst 2025-06-06 17:23:11.981 | [backend] info: [OllamaEmbedder] initialized with model bge-m3:latest at http://172.17.0.1:11434. num_ctx: 600 2025-06-06 17:23:11.984 | [backend] info: [RecursiveSplitter] Will split with {"chunkSize":600,"chunkOverlap":100} 2025-06-06 17:23:11.984 | [backend] info: Chunks created from document: 10 2025-06-06 17:23:11.985 | [backend] info: [OllamaEmbedder] Embedding 10 chunks of text with bge-m3:latest. 2025-06-06 17:23:12.448 | [backend] info: Inserting vectorized chunks into Milvus. 2025-06-06 17:23:12.471 | [backend] info: Caching vectorized results of SST/quoi-faire-harcelement.docx-ba1526d1-6a1f-432c-b7a2-4f2d7992d7f9.json to prevent duplicated embedding. 2025-06-06 17:23:12.643 | [backend] info: [TELEMETRY SENT] {"event":"documents_embedded_in_workspace","distinctId":"1ce1fa87-f54c-4208-a020-750c6d6ec7b6","properties":{"LLMSelection":"ollama","Embedder":"ollama","VectorDbSelection":"milvus","TTSSelection":"native","LLMModel":"qwen3:8b-q4_K_M","runtime":"docker"}} 2025-06-06 17:23:12.659 | [backend] info: [Event Logged] - workspace_documents_added
yindo commented 2026-02-22 18:30:03 -05:00
Author
Owner
Copy Link
Copy Source

@alainlizotte commented on GitHub (Jun 6, 2025):

Never during the process, the VRAM or GPU got maxed out.

@alainlizotte commented on GitHub (Jun 6, 2025): Never during the process, the VRAM or GPU got maxed out.
yindo commented 2026-02-22 18:30:03 -05:00
Author
Owner
Copy Link
Copy Source

@alainlizotte commented on GitHub (Jun 6, 2025):

I'm using the latest version of AnythingLLM, Ollama and Docker.

But this error was there with older releases too.

@alainlizotte commented on GitHub (Jun 6, 2025): I'm using the latest version of AnythingLLM, Ollama and Docker. But this error was there with older releases too.
yindo commented 2026-02-22 18:30:03 -05:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (Jun 9, 2025):

The error in AnythingLLM is appening during the line ([backend] info: [OllamaEmbedder] Embedding 962 chunks of text with bge-m3:latest.)

This would very much seem to be related to the Ollama embedder basically be overwhelmed
https://github.com/Mintplex-Labs/anything-llm/blob/020acde3b9831daf16ea174b2edbbda6272f61ea/server/utils/EmbeddingEngines/ollama/index.js#L78-L80

What do you have set as the max token size for this model? It should be 8192 max but I would go a bit under just for how tokenization occurs since it would be super accurate for each chunk

@timothycarambat commented on GitHub (Jun 9, 2025): > The error in AnythingLLM is appening during the line ([backend] info: [OllamaEmbedder] Embedding 962 chunks of text with bge-m3:latest.) This would very much seem to be related to the Ollama embedder basically be overwhelmed https://github.com/Mintplex-Labs/anything-llm/blob/020acde3b9831daf16ea174b2edbbda6272f61ea/server/utils/EmbeddingEngines/ollama/index.js#L78-L80 What do you have set as the max token size for this model? It should be 8192 max but I would go a bit under just for how tokenization occurs since it would be super accurate for each chunk
yindo commented 2026-02-22 18:30:03 -05:00
Author
Owner
Copy Link
Copy Source

@alainlizotte commented on GitHub (Jun 9, 2025):

@timothycarambat

Image
Image
Image

@alainlizotte commented on GitHub (Jun 9, 2025): @timothycarambat ![Image](https://github.com/user-attachments/assets/c8f7d0ba-aa4c-490e-9dcc-b7a3129739f9) ![Image](https://github.com/user-attachments/assets/7ac28924-dbbe-4cf7-a5b0-93643669a896) ![Image](https://github.com/user-attachments/assets/e2c421f6-fdc9-4f71-906d-8041a133f76d)
yindo commented 2026-02-22 18:30:03 -05:00
Author
Owner
Copy Link
Copy Source

@alainlizotte commented on GitHub (Jun 9, 2025):

@timothycarambat

Here is my Ollama Log while embedding.

ollama_log.txt

@alainlizotte commented on GitHub (Jun 9, 2025): @timothycarambat Here is my Ollama Log while embedding. [ollama_log.txt](https://github.com/user-attachments/files/20659129/ollama_log.txt)
yindo commented 2026-02-22 18:30:04 -05:00
Author
Owner
Copy Link
Copy Source

@alainlizotte commented on GitHub (Jun 9, 2025):

The error message at the end may be because I just tried to enable KeepAlive = 5min.

@alainlizotte commented on GitHub (Jun 9, 2025): The error message at the end may be because I just tried to enable KeepAlive = 5min.
yindo commented 2026-02-22 18:30:04 -05:00
Author
Owner
Copy Link
Copy Source

@alainlizotte commented on GitHub (Jun 11, 2025):

Same result with new AnythingLLM release.

@alainlizotte commented on GitHub (Jun 11, 2025): Same result with new AnythingLLM release.
yindo commented 2026-02-22 18:30:04 -05:00
Author
Owner
Copy Link
Copy Source

@alainlizotte commented on GitHub (Jun 24, 2025):

Tryied a lot of things as you can see here:
https://discord.com/channels/1114740394715004990/1383199890493935617

Nothing fixed the error. :(

@alainlizotte commented on GitHub (Jun 24, 2025): Tryied a lot of things as you can see here: https://discord.com/channels/1114740394715004990/1383199890493935617 Nothing fixed the error. :(
yindo changed title from [BUG]: Embedding timeout to [GH-ISSUE #3962] [BUG]: Embedding timeout 2026-06-05 14:47:01 -04:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Desktop
Docker
Integration Request
Integration Request
OS: Linux
OS: Mobile
OS: Windows
UI/UX
blocked
bug
bug
core-team-only
documentation
duplicate
embed-widget
enhancement
feature request
github_actions
good first issue
investigating
needs info / can't replicate
possible bug
pull-request
Mirrored from GitHub Pull Request
 question
stage: specifications
wontfix
No Label needs info / can't replicate possible bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#2523
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?