mirror of
https://github.com/Mintplex-Labs/anything-llm.git
synced 2026-07-19 14:13:35 -04:00
[GH-ISSUE #1265] [BUG]: Docker Compose crashes on getting response or opening workspace settings #791
Closed
opened 2026-02-22 18:21:22 -05:00 by yindo
·
23 comments
No Branch/Tag Specified
master
5846-bug-when-scrolling-up-scrolling-jumps
refactor-remove-workspace-pfp
5969-bug-stopgenerationbutton-disappears-on-the-first-prompt-that-initiates-an-agent-session
2235-bug-how-to-upload-a-folder-with-subfolders-with-files-to-anythingllm
5990-workspace-update-fails-with-unknown-argument-router_id-v1130v1150-intel-mac
opencomputer-examples
pg
feat/image-generation-translations
feat/image-generation
5924-bug-meeting-summary-fails-with-sincludes-is-not-a-function-when-default-llm-is-anthropic-claude
render
feat/uniform-modal-component
5883-bug-unescaped-content-in-json-strings-being-passed-to-document-generator-tools
5901-bug-api-update-embeddings-fails-prisma-argument-filename-is-missing-on-workspace_documentscreate-desktop-windows-v1141
hybrid-search
1981-translations
5752-bug-prompts-to-local-jan-endpoint-unresponsive
feat-disable-native-tool-calling-env-var
5676-bug-non-ollama-agent-providers-do-not-parse-and-present-reasoning-content
feat/markdown-web-scraping
5717-bug-apiv1documentupload-silently-drops-metadata-field-in-desktop-1130-arg-count-mismatch-nested-payload-key
fix/aibitat-context-overflow
5711-bug-erratic-deepseek-v4-flash-the-agent-model-failed-to-respond-400-the-reasoning_content
5631-feat-custom-api-request-timeouts-for-ai-providers
feat-reasoning-control
feat-agent-clarifying-questions-translations
5583-bug-lm-studio-provider-does-not-present-reasoning-output
5313-normalize-translations
feat/memory-translations
5305-lemonade-embedding-engine-swallows-errors-falsely-reports-documents-as-embedded
5060-bug-agent-interactions-agent-are-not-persisted-to-thread-history-via-api
pptx-subagent
feat-render-images-from-mcp-tool-results
stt-provider-expansion-openai-api-compatible
feat-file-search-agent-tool
feat-native-embedder-job-queue
5189-normalize-translations
feat-file-search-agent-tool-translations
i18n-eslint
5140-auto-migration
5112-bug-openrouter-failed-message-bug
3506-feat-parameters-for-openrouter-models
4992-feat-preserve-scroll-position
4973-bug-markdown-numbered-list-display-in-reasoning-pane
desktop
4938-bug-pending-chat-rerendering-ui-bug
quickstart-env
node-llama-cpp-in-container-cuda
node-llama-cpp-in-container
ollama-in-container
4817-feat-set-cooldown-per-mcp-server
4845-keyboard-shortcuts-to-navigate-in-chat
4844-feat-reorder-threads-by-latest-interaction
standardize-username-constraints-normalize-translations
4792-feat-refactor-workspacepfp-image
1382-embed-ip-improvements
1382-bug-embed-api-improvements
refactor-eslint-frontend
4687-feat-refactor-vector-db-providers
4615-feat-disable-apidocs-with-environment-variable
4559-feat-agent-web-search-enable-ordering-of-results
4599-bug-ollama-race-condition-bug
4572-bug-lmstudio-provided-llm-stopped-working-with-anything-llm-after-upgrading-to-190
4508-agent-youtube-transcript-analysis
4497-feat-workspace-names
frontend-eslint
ollama-lmstudio-auto-context-window
4431-validate-vector-database-connectioN
2019-slash-command-keyboard-selection
microsoft-foundry-provider
4431-validate-vector-database-connection
4325-sys-prompt-var-improvements
3209-feat-apiv1workspacestream-chat-sources-citations
4210-bug-voice-to-text-overwrite
4136-feat-jan-as-a-backend-server-option
4172-feat-openai-o3-support
1.8.3-rerelease
web-push-notifications-service
tasks
3955-feat-jinaai-embedder-provider-support
3921-feat-agent-skills-uiux-improvements
3901-bug-validfunccall-checks-optional-arguments
keyboard-dev
1787-custom-roles-and-permissions
add-jira-slack-data-connector
office-extension-wip
lightmode-dropdown-color-update
3586-bug-agent-flow-function-description-provided-by-user-is-not-seen-in-the-llm-query
3463-bug-agent-continues-to-run-if-request-failed-even-after-exit
3439-feat-call-variables-within-the-flow-api-block-url-field
3282-manager-view-models-workspace
3280-token-counting-server-side-truncation-improvements
3147-bug-embedded-chat-widget---not-considering-query-mode-option-always-working-in-chat-mode
2995-feat-disable-temperature-setting-for-deepseek-r1-deepseek-reasoner-model
2827-feat-perplexity-citations
2866-feat-finally-a-gemini-models-endpoint
2647-feat-hpp-header-for-a-c++-code-file-mime-addition
lancedb-revert
1656-feat-implement-tooltip-ui-designs
2011-feat-bump-perplexity-models
1873-feat-auto-add-and-watch-folder-for-document-uploads
1297-feat-gemini-agent-support
1759-bug-ui-bug-fixes
1686-feat-implement-winston-for-logging
1536-bug-toggling-on-users-can-delete-workspaces-does-not-take-effect
agent-ui-mobile-styles
1522-feat-chromadb-support
1595-bug-unable-to-get-live-web-search-and-browsing-agent-working-using-google-custom-search-engine-error-getaddrinfo-enotfound-http-errno-3008
1582-bug-lm-studio-does-not-allow-for-different-model-selection
1312-bug-usernames-should-not-be-case-sensitive-when-logging-in
1029-feat-hf-serverless-inference-api
1086-feat-implement-normalized-input-fields
knowledge-graph-support
644-bug-uploaded-file-name-does-not-match-the-displayed-file-name-after-the-upload
v1.15.0
v1.14.2
v1.14.1
v1.14.0
v1.13.0
v1.12.1
v1.12.0
v1.11.2
v1.11.1
v1.11.0
v1.10.0
v1.9.1
v1.9.0
v1.8.5
v1.8.4
v1.8.3
v1.8.2
v1.8.1
v1.8.0
v1.7.8
v1.7.6
v1.7.5
v1.7.4
v1.4.0
v1.3.0
v1.2.4
v1.2.3
v1.2.2
v1.2.1
v1.2.0
v1.1.1
v1.1.0
v1.0.0
Labels
Clear labels
Desktop
Docker
Integration Request
Integration Request
OS: Linux
OS: Mobile
OS: Windows
UI/UX
blocked
bug
bug
core-team-only
documentation
duplicate
embed-widget
enhancement
feature request
github_actions
good first issue
investigating
needs info / can't replicate
possible bug
pull-request
question
stage: specifications
wontfix
Mirrored from GitHub Pull Request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Notifications
Due Date
No due date set.
Dependencies
No dependencies set.
Reference: Mintplex-Labs/anything-llm#791
Reference in New Issue
Block a user
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @iFloris on GitHub (May 2, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/1265
How are you running AnythingLLM?
Docker (local)
What happened?
Since a few days my docker compose AnythingLLM setup crashes, whenever I ask for an LLM response in a thread or open workspace settings.
The following is shown in the docker logs:
anythingllm-1 | /usr/local/bin/docker-entrypoint.sh: line 7: 164 Illegal instruction (core dumped) node /app/server/index.js
anythingllm-1 exited with code 0
Docker compose restarts the container, but it keeps happening.
I use groq, but it also happens when connected to a local ollama.
What did I do to break things?
Are there known steps to reproduce?
This happens when I ask for any response in a thread or when I open workspace settings (url/workspace/workspace-name/settings/general-appearance).
@timothycarambat commented on GitHub (May 2, 2024):
What does your docker-compose look like? This seems like some directory or something is being mounted that should not be. Likely some library that should exist but isn't?
@timothycarambat commented on GitHub (May 2, 2024):
This has been reported before and this was the case see this SO comment
@iFloris commented on GitHub (May 3, 2024):
Hi, thanks for getting back to me @timothycarambat you are right, it was docker compose related. I had a very simple custom docker compose setup, which apparently no longer works:
So I used the 'official' docker compose with build steps. I have copied over my sqlite db and assets dir to the server/storage folder. After fiddling with permissions, that now works too.
However, with the new docker compose configuration, I still get this:
my docker compose now looks like this, which allows me to succesfully complete the build steps and start the application:
I could well be wrong, but it does not seem to me I'm mounting directories incorrectly, as the build process completes succesfully for x86/x64?
@timothycarambat commented on GitHub (May 3, 2024):
No that seems correct to me. Are you building on and ARM device? I think by default, unless specified, docker compose will build in compatibility mode, but since our dockerfile supports both arch's it should enable autodetection.
What chip arch are you on?
@iFloris commented on GitHub (May 3, 2024):
Hello @timothycarambat this is on a Xeon server.
@timothycarambat commented on GitHub (May 3, 2024):
Then that makes sense, Xeon is x86, not arm so it makes sense to only build for amd64
@iFloris commented on GitHub (May 3, 2024):
So this is interesting, I copied my (original, simple) docker compose file to another server and AnythingLLM works there.
The difference:
This currently works:
This does not:
So I updated my dns to point to this server instead, but it's still a pretty weird problem.
@timothycarambat commented on GitHub (May 3, 2024):
While i cant nail down exactly why this occurs i can say that we have had issues reported with Proxmox before, but i dont have that system available to us so i cannot replicate to debug remotely, but i recall is was either permissions or port related
@sbrosl commented on GitHub (May 3, 2024):
Hi Tim,
I am also experiencing this issue in a VM but using Hyper-V. This showed up when I pulled the :latest docker image two days ago. I don't build the project just use the image. I tried removing the /app/server/storage volume from the docker-compose file to be sure its not my folder giving permission issues and the issue persist with that being freshly populated by the image.
I've turned on debug logging for node, here are the last lines before the error
Let me know if there's anything you'd like me to run or test to help figure out the issue
Thanks!
@timothycarambat commented on GitHub (May 3, 2024):
This issue is because the default
lancedbvector db does not have support (or can determine) which binary it needs to run lancedb.i would imagine linux x64 would be right?
@iFloris commented on GitHub (May 4, 2024):
That's interesting, so the problem originated in the vectordb. That would explain why the web ui crashed when opening workspace settings.
Yes, I believe that linux x64 is right.
The machine that doesn't work (bare metal):
Linux 6.8.4-2-pve #1 SMP PREEMPT_DYNAMIC PMX 6.8.4-2 (2024-04-10T17:36Z) x86_64 GNU/Linuxand the KVM that does work:
Linux 4.19.0-26-amd64 #1 SMP Debian 4.19.304-1 (2024-01-09) x86_64 GNU/Linux@timothycarambat commented on GitHub (May 4, 2024):
This seems like now more of a support issue for https://github.com/lancedb/lancedb
That being said, we are on package
0.4.11so it is possible could have been fixed since in the SDK. Obviously such a critical piece like the vectordb we have to bump very carefully.@iFloris commented on GitHub (May 5, 2024):
Yes, I think you are right @timothycarambat. Thanks for the help investigating and the great tool!
@sbrosl commented on GitHub (May 6, 2024):
Hi @timothycarambat,
I can confirm that I am on Linux x64 as well and the project is running in a podman container.
Could I suggest tagging the docker images with release versions like the desktop app? Simply so we could roll back in case of issues like this arising. Right now our instance is broken; even with no documents uploaded it crashes because of the default integrated LanceDB. The best option to "fix" this seems to be setting up an alternative vectordb (which is the route I am currently taking, two issues throwing the same error are currently open on the LanceDB repo since oct-nov of 2023 (https://github.com/lancedb/lancedb/issues/592 and https://github.com/lancedb/lancedb/issues/631) so I'm not sure Anything-LLM will start working for us with lancedb anytime soon).
Let me know if there is anything I can do to help. I'd like to echo iFloris and thank you and the community for the amazing open source project that is Anything-LLM!
@computersrmyfriends commented on GitHub (May 23, 2024):
I have the same issue. Does not work on XEON E5 2660
@timothycarambat commented on GitHub (May 23, 2024):
@computersrmyfriends use the non-native embedder. ONNX cannot run on your CPU, so native model running will not work.
@computersrmyfriends commented on GitHub (May 23, 2024):
Thank you for the response @timothycarambat . I will try that
@computersrmyfriends commented on GitHub (May 23, 2024):
I think you meant this ☝ @timothycarambat . I changed it.
But,even after that, once I send a message "hi" to the model on the workspace, it crashes,,,,
@timothycarambat commented on GitHub (May 23, 2024):
Does sending a chat on an empty workspace work? Should not run any command on the embedder or vectordb. Referring to the thread, it looks like an invalid binary from lanceDB if the embedder can be ruled out
@computersrmyfriends commented on GitHub (May 23, 2024):
Thanks for the super quick response.
The moment i created the workspace, it crashed again.
Then, i sent hi to the new workspace after restarting the container..., it crashed again..

@computersrmyfriends commented on GitHub (May 23, 2024):
@timothycarambat Now, I tried chromadb...
It does not crash now. So, the crashing issue was due to the inbuilt Vectordb.
But, it gives me this error:
@computersrmyfriends commented on GitHub (May 23, 2024):
@timothycarambat I tried creating another new workspace. With chromadb, it seems to be some different issue. it was giving an error twice and then it crashed.
@computersrmyfriends commented on GitHub (May 23, 2024):
Also errors from chromadb container if it might help:
[BUG]: Docker Compose crashes on getting response or opening workspace settingsto [GH-ISSUE #1265] [BUG]: Docker Compose crashes on getting response or opening workspace settings