cloudstack-llc/msty-docs
1
0
Fork 0
mirror of https://github.com/cloudstack-llc/msty-docs.git synced 2026-07-18 18:54:38 -04:00
Code Issues 6 Packages Projects Releases Wiki Activity

docs: update manual Local AI service update instructions

Browse Source
This commit is contained in:
Ashok Gelal
2024-09-19 14:17:02 -04:00
parent b3de41c5d3
commit 64d966fda4
1 changed files with 22 additions and 8 deletions
Download Patch File Download Diff File Expand all files Collapse all files
content/2.how-to guides/get the latest version of local ai service.md
+22 -8
View File
@@ -23,9 +23,9 @@ chmod +x ~/Library/Application\ Support/Msty/msty-local
1. Go to releases page on the Ollama repository: https://github.com/ollama/ollama/releases
2. From under `Assets`, download the latest version of Ollama for Windows by downloading `ollama-windows-amd64.zip`.
3. Once downloaded, extract the contents of the zip file and copy `ollama-windows.exe` to `C:\Users\<username>\AppData\Roaming\Msty` and rename it as `msty-local.exe`.
4. Copy `ollama_runners` folder to `C:\Users\<username>\AppData\Roaming\Msty`.
5. If you are on NVIDIA GPU, copy `cuda` folder to `C:\Users\<username>\AppData\Roaming\Msty`.
6. If you are on AMD GPU, copy `rocm` folder to `C:\Users\<username>\AppData\Roaming\Msty`.
4. Copy `lib` folder to `C:\Users\<username>\AppData\Roaming\Msty`.
5. If you are on NVIDIA GPU, you can optionally remove `rocm`
6. If you are on AMD GPU, you can optionally remove `cuda`
7. Restart Msty and verify the version of Local AI service by going to `Settings` > `Local AI Service > Service Version`.
**Note**: There is a small annoyance with the official build of Ollama where during chatting it opens up a blank Terminal window. You could just ignore it or wait for the latest
@@ -33,12 +33,26 @@ release of Msty. We have sent a PR to Ollama team and waiting for it to get merg
## On Linux
1. Go to releases page on the Ollama repository: https://github.com/ollama/ollama/releases
2. From under `Assets`, download the latest version of Ollama for Linux by downloading the one appropriate for your system - either `ollama-linux-amd64` or `ollama-linux-arm64`
3. Once downloaded, copy it to `~/.config/Msty` and rename it as `msty-local`
4. Open Terminal and run the following command to make the file executable:
### For CUDA users:
1. Go to releases page on the Ollama repository: https://github.com/ollama/ollama/releases
2. From under `Assets`, download the latest version of Ollama for Linux - `ollama-linux-amd64.tgz`
3. Once downloaded, copy `lib` to `~/.config/Msty/`
4. Copy `bin/ollama` to `~/.config/Msty/` and rename it as `msty-local`
5. Open Terminal and run the following command to make the file executable:
```bash
chmod +x ~/.config/Msty/msty-local
```
5. Restart Msty and verify the version of Local AI service by going to `Settings` > `Local AI Service > Service Version`.
6. Restart Msty and verify the version of Local AI service by going to `Settings` > `Local AI Service > Service Version`.
### For ROCm (AMD GPU) users:
1. Go to releases page on the Ollama repository: https://github.com/ollama/ollama/releases
2. From under `Assets`, download the latest version of Ollama for Linux by downloading the one appropriate for your system - either `ollama-linux-amd64-rocm.tgz`
3. Once downloaded, copy `lib` to `~/.config/Msty/`
4. Copy `bin/ollama` to `~/.config/Msty/` and rename it as `msty-local`
5. Open Terminal and run the following command to make the file executable:
```bash
chmod +x ~/.config/Msty/msty-local
```
6. Restart Msty and verify the version of Local AI service by going to `Settings` > `Local AI Service > Service Version`.