mirror of
https://github.com/Mintplex-Labs/anything-llm.git
synced 2026-07-19 22:23:50 -04:00
[GH-ISSUE #1795] [BUG]: Ollama call failed with status code 500: llama runner process has terminated: exit status 0xc0000135 | Windows #1173
Closed
opened 2026-02-22 18:23:30 -05:00 by yindo
·
9 comments
No Branch/Tag Specified
master
5846-bug-when-scrolling-up-scrolling-jumps
refactor-remove-workspace-pfp
5969-bug-stopgenerationbutton-disappears-on-the-first-prompt-that-initiates-an-agent-session
2235-bug-how-to-upload-a-folder-with-subfolders-with-files-to-anythingllm
5990-workspace-update-fails-with-unknown-argument-router_id-v1130v1150-intel-mac
opencomputer-examples
pg
feat/image-generation-translations
feat/image-generation
5924-bug-meeting-summary-fails-with-sincludes-is-not-a-function-when-default-llm-is-anthropic-claude
render
feat/uniform-modal-component
5883-bug-unescaped-content-in-json-strings-being-passed-to-document-generator-tools
5901-bug-api-update-embeddings-fails-prisma-argument-filename-is-missing-on-workspace_documentscreate-desktop-windows-v1141
hybrid-search
1981-translations
5752-bug-prompts-to-local-jan-endpoint-unresponsive
feat-disable-native-tool-calling-env-var
5676-bug-non-ollama-agent-providers-do-not-parse-and-present-reasoning-content
feat/markdown-web-scraping
5717-bug-apiv1documentupload-silently-drops-metadata-field-in-desktop-1130-arg-count-mismatch-nested-payload-key
fix/aibitat-context-overflow
5711-bug-erratic-deepseek-v4-flash-the-agent-model-failed-to-respond-400-the-reasoning_content
5631-feat-custom-api-request-timeouts-for-ai-providers
feat-reasoning-control
feat-agent-clarifying-questions-translations
5583-bug-lm-studio-provider-does-not-present-reasoning-output
5313-normalize-translations
feat/memory-translations
5305-lemonade-embedding-engine-swallows-errors-falsely-reports-documents-as-embedded
5060-bug-agent-interactions-agent-are-not-persisted-to-thread-history-via-api
pptx-subagent
feat-render-images-from-mcp-tool-results
stt-provider-expansion-openai-api-compatible
feat-file-search-agent-tool
feat-native-embedder-job-queue
5189-normalize-translations
feat-file-search-agent-tool-translations
i18n-eslint
5140-auto-migration
5112-bug-openrouter-failed-message-bug
3506-feat-parameters-for-openrouter-models
4992-feat-preserve-scroll-position
4973-bug-markdown-numbered-list-display-in-reasoning-pane
desktop
4938-bug-pending-chat-rerendering-ui-bug
quickstart-env
node-llama-cpp-in-container-cuda
node-llama-cpp-in-container
ollama-in-container
4817-feat-set-cooldown-per-mcp-server
4845-keyboard-shortcuts-to-navigate-in-chat
4844-feat-reorder-threads-by-latest-interaction
standardize-username-constraints-normalize-translations
4792-feat-refactor-workspacepfp-image
1382-embed-ip-improvements
1382-bug-embed-api-improvements
refactor-eslint-frontend
4687-feat-refactor-vector-db-providers
4615-feat-disable-apidocs-with-environment-variable
4559-feat-agent-web-search-enable-ordering-of-results
4599-bug-ollama-race-condition-bug
4572-bug-lmstudio-provided-llm-stopped-working-with-anything-llm-after-upgrading-to-190
4508-agent-youtube-transcript-analysis
4497-feat-workspace-names
frontend-eslint
ollama-lmstudio-auto-context-window
4431-validate-vector-database-connectioN
2019-slash-command-keyboard-selection
microsoft-foundry-provider
4431-validate-vector-database-connection
4325-sys-prompt-var-improvements
3209-feat-apiv1workspacestream-chat-sources-citations
4210-bug-voice-to-text-overwrite
4136-feat-jan-as-a-backend-server-option
4172-feat-openai-o3-support
1.8.3-rerelease
web-push-notifications-service
tasks
3955-feat-jinaai-embedder-provider-support
3921-feat-agent-skills-uiux-improvements
3901-bug-validfunccall-checks-optional-arguments
keyboard-dev
1787-custom-roles-and-permissions
add-jira-slack-data-connector
office-extension-wip
lightmode-dropdown-color-update
3586-bug-agent-flow-function-description-provided-by-user-is-not-seen-in-the-llm-query
3463-bug-agent-continues-to-run-if-request-failed-even-after-exit
3439-feat-call-variables-within-the-flow-api-block-url-field
3282-manager-view-models-workspace
3280-token-counting-server-side-truncation-improvements
3147-bug-embedded-chat-widget---not-considering-query-mode-option-always-working-in-chat-mode
2995-feat-disable-temperature-setting-for-deepseek-r1-deepseek-reasoner-model
2827-feat-perplexity-citations
2866-feat-finally-a-gemini-models-endpoint
2647-feat-hpp-header-for-a-c++-code-file-mime-addition
lancedb-revert
1656-feat-implement-tooltip-ui-designs
2011-feat-bump-perplexity-models
1873-feat-auto-add-and-watch-folder-for-document-uploads
1297-feat-gemini-agent-support
1759-bug-ui-bug-fixes
1686-feat-implement-winston-for-logging
1536-bug-toggling-on-users-can-delete-workspaces-does-not-take-effect
agent-ui-mobile-styles
1522-feat-chromadb-support
1595-bug-unable-to-get-live-web-search-and-browsing-agent-working-using-google-custom-search-engine-error-getaddrinfo-enotfound-http-errno-3008
1582-bug-lm-studio-does-not-allow-for-different-model-selection
1312-bug-usernames-should-not-be-case-sensitive-when-logging-in
1029-feat-hf-serverless-inference-api
1086-feat-implement-normalized-input-fields
knowledge-graph-support
644-bug-uploaded-file-name-does-not-match-the-displayed-file-name-after-the-upload
v1.15.0
v1.14.2
v1.14.1
v1.14.0
v1.13.0
v1.12.1
v1.12.0
v1.11.2
v1.11.1
v1.11.0
v1.10.0
v1.9.1
v1.9.0
v1.8.5
v1.8.4
v1.8.3
v1.8.2
v1.8.1
v1.8.0
v1.7.8
v1.7.6
v1.7.5
v1.7.4
v1.4.0
v1.3.0
v1.2.4
v1.2.3
v1.2.2
v1.2.1
v1.2.0
v1.1.1
v1.1.0
v1.0.0
Labels
Clear labels
Desktop
Docker
Integration Request
Integration Request
OS: Linux
OS: Mobile
OS: Windows
UI/UX
blocked
bug
bug
core-team-only
documentation
duplicate
embed-widget
enhancement
feature request
github_actions
good first issue
investigating
needs info / can't replicate
possible bug
pull-request
question
stage: specifications
wontfix
Mirrored from GitHub Pull Request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Notifications
Due Date
No due date set.
Dependencies
No dependencies set.
Reference: Mintplex-Labs/anything-llm#1173
Reference in New Issue
Block a user
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @njss on GitHub (Jun 30, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/1795
Originally assigned to: @timothycarambat on GitHub.
How are you running AnythingLLM?
Docker (local)
What happened?
When trying to ask a question, I get the following error message (using any models):
Ollama call failed with status code 500: llama runner process has terminated: exit status 0xc0000135
Are there known steps to reproduce?
Configure the sw
upload a pdf document
ask a question
@RockinRoddieAi commented on GitHub (Jun 30, 2024):
I am facing the exact same issue. I installed version 1.5.8. I have this issue on both of my Windows 11 Pro computers
I have tried to uninstall the model(s) and reinstall them and no go. This error renders Anything LLM useless and unusable. :(
I uninstalled 1.5.8 and went back to 1.5.7 and it works on both of my PCs
@droza123 commented on GitHub (Jul 1, 2024):
Same problem here with 1.5.8. Totally fresh install.
@timothycarambat commented on GitHub (Jul 1, 2024):
This error is obviously tied back to ollama, I have a feeling it is device related. Please run the app in debug mode and on boot and when sending a chat there should be logs that describe the whole ollama runtime
https://docs.useanything.com/debug#anythingllm-debug-mode-on-windows
I will need those to help. I would prefer to not go back to the previous Ollama version as it is slower and the newer version has improved greatly.
Other details:
@timothycarambat commented on GitHub (Jul 1, 2024):
You can just use literally any other provider to get around this. Does downloading Ollama directly from them and just connecting with AnythingLLM still yield the same issue?
@RockinRoddieAi commented on GitHub (Jul 1, 2024):
Yah downloading directly did not seem to resolve the issue with 1.5.8. And yes I understand i can use other providers, i was trying to keep my deployment straight forward.
@RockinRoddieAi commented on GitHub (Jul 1, 2024):
Hi
I followed the debugging mode instructions. Log file details are below.
I have this issue on two issues:
Workstation specs:
GPU = Yes
NVIDIA GeForce RTX 3090
CPU = 12th Gen Intel Core i9-1290 3.19 GHz and yes it supports AVX
Laptop specs:
GPU = Yes
NVIDIA GeForce RTX 3050
CPU = 12th Gen Intel Core i-12700H 2.30 GHz and yes it supports AVX
C:\Users\r0ss\AppData\Local\Programs\anythingllm-desktop>
[Preferences] preference config stored at C:\Users\r0ss\AppData\Roaming\anythingllm-desktop\config.json
Prisma schema loaded from prisma\schema.prisma
Datasource "db": SQLite database "anythingllm.db" at "file:C:/Users/r0ss/AppData/Roaming/anythingllm-desktop/storage/anythingllm.db"
Already in sync, no schema change or pending migration was found.
Γ£ö Generated Prisma Client (v5.3.1) to .@.***\client in 342ms
Prisma schema loaded from prisma\schema.prisma
Γ£ö Generated Prisma Client (v5.3.1) to .@.***\client in 309ms
Start using Prisma Client in Node.js (See: https://pris.ly/d/client)
or start using Prisma Client at the edge (See: https://pris.ly/d/accelerate)
See other ways of importing Prisma Client: http://pris.ly/d/importing-client
[OllamaProcessManager] Ollama will bind on port 11434 when booted.
[Preferences] Will load window with last know bounds.
Collector hot directory and tmp storage wiped!
[production] AnythingLLM Standalone Document processor listening on port 8888
[TELEMETRY ENABLED] Anonymous Telemetry enabled. Telemetry helps Mintplex Labs Inc improve AnythingLLM.
prisma:info Starting a sqlite pool with 33 connections.
[TELEMETRY SENT] {
event: 'server_boot',
distinctId: 'd0bfea5d-0865-477d-bd01-2fd3a4f18feb',
properties: { runtime: 'desktop' }
}
Hot loading of AnythingLLMOllama - LLM_PROVIDER is anythingllm_ollama.
[NativeEmbedder] Initialized
[CommunicationKey] RSA key pair generated for signed payloads within AnythingLLM services.
[EncryptionManager] Loaded existing key & salt for encrypting arbitrary data.
[production] AnythingLLM Standalone Backend listening on port 3001
[BackgroundWorkerService] Feature is not enabled and will not be started.
[OllamaProcessManager] SINGLETON LOCK: Using existing OllamaProcessManager.
[OllamaProcessManager] [windows] Ollama subprocess running. Port 11434. PID 39160.
OllamaAPI offline - retrying. 1/3
[NativeEmbedder] Initialized
Error: Ollama call failed with status code 500: llama runner process has terminated: exit status 0xc0000135
response: Response {
}
}
From: Timothy Carambat @.>
Sent: Monday, July 1, 2024 10:36 AM
To: Mintplex-Labs/anything-llm @.>
Cc: RockinRoddieAi @.>; Comment @.>
Subject: Re: [Mintplex-Labs/anything-llm] [BUG]: Not working on windows 11. Ollama call failed with status code 500: llama runner process has terminated: exit status 0xc0000135 (Issue #1795)
This error is obviously tied back to ollama, I have a feeling it is device related. Please run the app in debug mode and on boot and when sending a chat there should be logs that describe the whole ollama runtime
https://docs.useanything.com/debug#anythingllm-debug-mode-on-windows
I will need those to help. I would prefer to not go back to the previous Ollama version as it is slower and the newer version has improved greatly.
Other details:
—
Reply to this email directly, view it on GitHub https://github.com/Mintplex-Labs/anything-llm/issues/1795#issuecomment-2200594885 , or unsubscribe https://github.com/notifications/unsubscribe-auth/BJRVGWJVTJCQJDPPCUC3IY3ZKGAPVAVCNFSM6AAAAABKENEBJSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEMBQGU4TIOBYGU .
You are receiving this because you commented. https://github.com/notifications/beacon/BJRVGWJBFAYPBUUZXBVFFW3ZKGAPVA5CNFSM6AAAAABKENEBJSWGG33NNVSW45C7OR4XAZNMJFZXG5LFINXW23LFNZ2KUY3PNVWWK3TUL5UWJTUDFJU4K.gif Message ID: @.*** @.***> >
@timothycarambat commented on GitHub (Jul 1, 2024):
We identified the root cause of this issue:
-> Client fails as ollama does not failover on CUDA library missing to CPU and aborts the process.
The fix was to include missing binaries for CUDA support. Currently, these will be pre-bundled with AnythingLLM windows, future updates may move them to a post-install process.
As such, downloading the latest version of AnythingLLM 1.5.8 as of July 1, 2024 ~11:20AM PST will download this patched version.
Installation may take longer than expected since we are going to unpack the supporting libraries now, but it will result in a working and GPU-enabled built-in Ollama experience.
@RockinRoddieAi commented on GitHub (Jul 1, 2024):
Thanks, that did the trick.
Super impressed with this support thread.
Keep up all the great work. I am thoroughly enjoying this app.
From: Timothy Carambat @.>
Sent: Monday, July 1, 2024 12:30 PM
To: Mintplex-Labs/anything-llm @.>
Cc: RockinRoddieAi @.>; Comment @.>
Subject: Re: [Mintplex-Labs/anything-llm] [BUG]: Ollama call failed with status code 500: llama runner process has terminated: exit status 0xc0000135 | Windows (Issue #1795)
We identified the root cause of this issue:
-> Client fails as ollama does not failover on CUDA library missing to CPU and aborts the process.
The fix was to include missing binaries for CUDA support. Currently, these will be pre-bundled with AnythingLLM windows, future updates may move them to a post-install process.
As such, downloading the latest version of AnythingLLM 1.5.8 https://s3.us-west-1.amazonaws.com/public.useanything.com/latest/AnythingLLMDesktop.exe as of July 1, 2024 ~11:20AM PST will download this patched version.
Installation may take longer than expected since we are going to unpack the supporting libraries now, but it will result in a working and GPU-enabled built-in Ollama experience.
—
Reply to this email directly, view it on GitHub https://github.com/Mintplex-Labs/anything-llm/issues/1795#issuecomment-2200769963 , or unsubscribe https://github.com/notifications/unsubscribe-auth/BJRVGWPJKO35AUHUCABKJBTZKGNZ5AVCNFSM6AAAAABKENEBJSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEMBQG43DSOJWGM .
You are receiving this because you commented. https://github.com/notifications/beacon/BJRVGWK2C7ZQ735HGMLT2DDZKGNZ5A5CNFSM6AAAAABKENEBJSWGG33NNVSW45C7OR4XAZNMJFZXG5LFINXW23LFNZ2KUY3PNVWWK3TUL5UWJTUDFUK2W.gif Message ID: @.*** @.***> >
@drgamedev commented on GitHub (Jul 22, 2025):
I am having the same issue. I've set up AnythingLLM. Then restarted. The same error is occurring again. Could someone please provide the precise steps to resolve it? Thanks.
[BUG]: Ollama call failed with status code 500: llama runner process has terminated: exit status 0xc0000135 | Windowsto [GH-ISSUE #1795] [BUG]: Ollama call failed with status code 500: llama runner process has terminated: exit status 0xc0000135 | Windows