From 64d966fda46e4f76b8fcc708c3ba2e554fbd4455 Mon Sep 17 00:00:00 2001 From: Ashok Gelal Date: Thu, 19 Sep 2024 14:17:02 -0400 Subject: [PATCH] docs: update manual Local AI service update instructions --- ... the latest version of local ai service.md | 30 ++++++++++++++----- 1 file changed, 22 insertions(+), 8 deletions(-) diff --git a/content/2.how-to guides/get the latest version of local ai service.md b/content/2.how-to guides/get the latest version of local ai service.md index e306f91..8e52753 100644 --- a/content/2.how-to guides/get the latest version of local ai service.md +++ b/content/2.how-to guides/get the latest version of local ai service.md @@ -23,9 +23,9 @@ chmod +x ~/Library/Application\ Support/Msty/msty-local 1. Go to releases page on the Ollama repository: https://github.com/ollama/ollama/releases 2. From under `Assets`, download the latest version of Ollama for Windows by downloading `ollama-windows-amd64.zip`. 3. Once downloaded, extract the contents of the zip file and copy `ollama-windows.exe` to `C:\Users\\AppData\Roaming\Msty` and rename it as `msty-local.exe`. -4. Copy `ollama_runners` folder to `C:\Users\\AppData\Roaming\Msty`. -5. If you are on NVIDIA GPU, copy `cuda` folder to `C:\Users\\AppData\Roaming\Msty`. -6. If you are on AMD GPU, copy `rocm` folder to `C:\Users\\AppData\Roaming\Msty`. +4. Copy `lib` folder to `C:\Users\\AppData\Roaming\Msty`. +5. If you are on NVIDIA GPU, you can optionally remove `rocm` +6. If you are on AMD GPU, you can optionally remove `cuda` 7. Restart Msty and verify the version of Local AI service by going to `Settings` > `Local AI Service > Service Version`. **Note**: There is a small annoyance with the official build of Ollama where during chatting it opens up a blank Terminal window. You could just ignore it or wait for the latest @@ -33,12 +33,26 @@ release of Msty. We have sent a PR to Ollama team and waiting for it to get merg ## On Linux -1. Go to releases page on the Ollama repository: https://github.com/ollama/ollama/releases -2. From under `Assets`, download the latest version of Ollama for Linux by downloading the one appropriate for your system - either `ollama-linux-amd64` or `ollama-linux-arm64` -3. Once downloaded, copy it to `~/.config/Msty` and rename it as `msty-local` -4. Open Terminal and run the following command to make the file executable: + +### For CUDA users: + +1. Go to releases page on the Ollama repository: https://github.com/ollama/ollama/releases +2. From under `Assets`, download the latest version of Ollama for Linux - `ollama-linux-amd64.tgz` +3. Once downloaded, copy `lib` to `~/.config/Msty/` +4. Copy `bin/ollama` to `~/.config/Msty/` and rename it as `msty-local` +5. Open Terminal and run the following command to make the file executable: ```bash chmod +x ~/.config/Msty/msty-local ``` -5. Restart Msty and verify the version of Local AI service by going to `Settings` > `Local AI Service > Service Version`. +6. Restart Msty and verify the version of Local AI service by going to `Settings` > `Local AI Service > Service Version`. +### For ROCm (AMD GPU) users: +1. Go to releases page on the Ollama repository: https://github.com/ollama/ollama/releases +2. From under `Assets`, download the latest version of Ollama for Linux by downloading the one appropriate for your system - either `ollama-linux-amd64-rocm.tgz` +3. Once downloaded, copy `lib` to `~/.config/Msty/` +4. Copy `bin/ollama` to `~/.config/Msty/` and rename it as `msty-local` +5. Open Terminal and run the following command to make the file executable: +```bash +chmod +x ~/.config/Msty/msty-local +``` +6. Restart Msty and verify the version of Local AI service by going to `Settings` > `Local AI Service > Service Version`.