mirror of
https://github.com/Mintplex-Labs/anythingllm-docs.git
synced 2026-07-21 09:15:22 -04:00
[PR #113] [MERGED] Add help docs for new Windows external bundle support #127
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
📋 Pull Request Information
Original PR: https://github.com/Mintplex-Labs/anythingllm-docs/pull/113
Author: @timothycarambat
Created: 11/5/2024
Status: ✅ Merged
Merged: 11/5/2024
Merged by: @timothycarambat
Base:
1.6.9-changelog← Head:windows-amd-external-support-download-faq📝 Commits (2)
c270b8bAdd help docs for new Windows external bundle support5e3efb1Merge branch '1.6.9-changelog' into windows-amd-external-support-download-faq📊 Changes
5 files changed (+83 additions, -1 deletions)
View changed files
📝
pages/installation-desktop/_meta.json(+10 -1)➕
pages/installation-desktop/manual-install.mdx(+52 -0)📝
pages/installation-desktop/windows.mdx(+21 -0)➕
public/images/getting-started/installation/windows/external-support.png(+0 -0)➕
public/images/getting-started/installation/windows/extract.png(+0 -0)📄 Description
As of 1.6.9 we now package the Ollama CUDA/ROC bindings external to the AnythingLLM application since including them would bloat the executable installer size to 3GB.
Instead, we now install these dependencies using a custom install macro to pull and place the bindings properly so the internal ollama process can find them. This unlocks full GPU support (NVIDIA, AMD) and even NPU support. Since these support libraries are only expected to grow, it makes sense to break them away from the full app.
We host these files on S3, which some users may be VPN-restricted or otherwise unable to pull in. If that is the case, we need documentation on how to do the install macro action manually.
🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.