Mintplex-Labs/anything-llm
1
0
Fork 0
mirror of https://github.com/Mintplex-Labs/anything-llm.git synced 2026-07-19 14:13:35 -04:00
Code Issues 328 Packages Projects Releases 10 Wiki Activity

[GH-ISSUE #1470] [BUG]: Non AVX CPU core dumps. #940

New Issue
Closed
opened 2026-02-22 18:22:19 -05:00 by yindo · 3 comments
yindo commented 2026-02-22 18:22:19 -05:00
Owner
Copy Link
Copy Source

Originally created by @Dozer316 on GitHub (May 21, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/1470

How are you running AnythingLLM?

Docker (local)

What happened?

Hi there,

The latest docker pull for anythingllm on a CPU with AVX (No AVX2) seems to result in a core dump when a search is performed after which the container shuts down. Running the same built image on a CPU with AVX2 support doesn't exhibit the same behaviour.
llm-1

I'm not sure which part of the stack is core dumping but the container logs shows.
[NativeEmbedder] Initialized
[NativeEmbedder] Initialized
[Event Logged] - update_embedding_engine
/usr/local/bin/docker-entrypoint.sh: line 7: 107 Illegal instruction (core dumped) node /app/server/index.js

If something is being compiled with the AVX2 flag enabled, would it be possible to provide a workaround for this on older CPUs with AVX support only?

Cheers.

Are there known steps to reproduce?

No response

Originally created by @Dozer316 on GitHub (May 21, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/1470 ### How are you running AnythingLLM? Docker (local) ### What happened? Hi there, The latest docker pull for anythingllm on a CPU with AVX (No AVX2) seems to result in a core dump when a search is performed after which the container shuts down. Running the same built image on a CPU with AVX2 support doesn't exhibit the same behaviour. ![llm-1](https://github.com/Mintplex-Labs/anything-llm/assets/42313740/ca29ef7a-5e38-4256-90e5-8cdf6f4b0b04) I'm not sure which part of the stack is core dumping but the container logs shows. [NativeEmbedder] Initialized [NativeEmbedder] Initialized [Event Logged] - update_embedding_engine /usr/local/bin/docker-entrypoint.sh: line 7: 107 Illegal instruction (core dumped) node /app/server/index.js If something is being compiled with the AVX2 flag enabled, would it be possible to provide a workaround for this on older CPUs with AVX support only? Cheers. ### Are there known steps to reproduce? _No response_
yindo added the possible bug label 2026-02-22 18:22:19 -05:00
yindo closed this issue 2026-02-22 18:22:19 -05:00
yindo commented 2026-02-22 18:22:19 -05:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (May 21, 2024):

This is related to https://github.com/Mintplex-Labs/anything-llm/issues/1331#issuecomment-2122238892

In fact, you just confirmed that hypothesis. The issue is that the underlying libraries do not support running ONNX on AVX arch CPUs. If you swap to another embedder model then you will not have this issue as you will not attempt to run anything via the ONNX runtime, which apparently does not support AVX?

@timothycarambat commented on GitHub (May 21, 2024): This is related to https://github.com/Mintplex-Labs/anything-llm/issues/1331#issuecomment-2122238892 In fact, you just confirmed that hypothesis. The issue is that the underlying libraries do not support running ONNX on AVX arch CPUs. If you swap to another embedder model then you will not have this issue as you will not attempt to run anything via the ONNX runtime, which apparently does not support AVX?
yindo commented 2026-02-22 18:22:19 -05:00
Author
Owner
Copy Link
Copy Source

@MrTAZ42 commented on GitHub (May 17, 2025):

Hi,
Anyone try to set OMP_NUM_THREADS=1 ?

@MrTAZ42 commented on GitHub (May 17, 2025): Hi, Anyone try to set OMP_NUM_THREADS=1 ?
yindo commented 2026-02-22 18:22:19 -05:00
Author
Owner
Copy Link
Copy Source

@nikita2206 commented on GitHub (May 20, 2025):

Was having similar issues with AnythingLLM in the docker container. Even with OpenAI embedder configured. I wasn't sure if AnythingLLM was maybe still using native embedder, but it looks like the issue might be in the vector database that is shipped together with AnythingLLM in the docker image (LanceDB); quick googling also suggests that it uses AVX.

@nikita2206 commented on GitHub (May 20, 2025): Was having similar issues with AnythingLLM in the docker container. Even with OpenAI embedder configured. I wasn't sure if AnythingLLM was maybe still using native embedder, but it looks like the issue might be in the vector database that is shipped together with AnythingLLM in the docker image (LanceDB); quick googling also suggests that it uses AVX.
yindo changed title from [BUG]: Non AVX CPU core dumps. to [GH-ISSUE #1470] [BUG]: Non AVX CPU core dumps. 2026-06-05 14:38:04 -04:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Desktop
Docker
Integration Request
Integration Request
OS: Linux
OS: Mobile
OS: Windows
UI/UX
blocked
bug
bug
core-team-only
documentation
duplicate
embed-widget
enhancement
feature request
github_actions
good first issue
investigating
needs info / can't replicate
possible bug
pull-request
Mirrored from GitHub Pull Request
 question
stage: specifications
wontfix
No Label possible bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#940
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?