From 0f8e532fb410c985eac38c3cc1249d4cff03a8b1 Mon Sep 17 00:00:00 2001 From: Ashok Gelal Date: Tue, 23 Jul 2024 10:03:58 -0400 Subject: [PATCH] howto: get the latest version of Local AI service --- ... the latest version of local ai service.md | 44 +++++++++++++++++++ 1 file changed, 44 insertions(+) create mode 100644 content/2.how-to guides/get the latest version of local ai service.md diff --git a/content/2.how-to guides/get the latest version of local ai service.md b/content/2.how-to guides/get the latest version of local ai service.md new file mode 100644 index 0000000..e306f91 --- /dev/null +++ b/content/2.how-to guides/get the latest version of local ai service.md @@ -0,0 +1,44 @@ +--- +title: Get the latest version of Local AI service +description: Learn how to get the latest version of Local AI service +--- + +For your convenience, Msty bundles the latest version of Local AI service (Ollama) with the app at the time of the app release. +However, if you want to get the latest version of Local AI service, first try going to `Settings` > `Local AI` > `Service Version` and clicking on `Check for updates`. +If there is a new version available, it will be downloaded. + +If you are unable to download the latest version of Local AI service using this method, you can follow the steps below to manually download and install the latest version of Local AI service. + +## On macOS +1. Go to releases page on the Ollama repository: https://github.com/ollama/ollama/releases +2. From under `Assets`, download the latest version of Ollama for macOS by downloading `ollama-darwin` (NOT `ollama-darwin.zip`). +3. Once downloaded, copy `ollama-darwin` to `~/Library/Application Support/Msty` and rename it as `msty-local`. +4. Open Terminal and run the following command to make the file executable: +```bash +chmod +x ~/Library/Application\ Support/Msty/msty-local +``` +5. Restart Msty and verify the version of Local AI service by going to `Settings` > `Local AI Service > Service Version`. + +## On Windows +1. Go to releases page on the Ollama repository: https://github.com/ollama/ollama/releases +2. From under `Assets`, download the latest version of Ollama for Windows by downloading `ollama-windows-amd64.zip`. +3. Once downloaded, extract the contents of the zip file and copy `ollama-windows.exe` to `C:\Users\\AppData\Roaming\Msty` and rename it as `msty-local.exe`. +4. Copy `ollama_runners` folder to `C:\Users\\AppData\Roaming\Msty`. +5. If you are on NVIDIA GPU, copy `cuda` folder to `C:\Users\\AppData\Roaming\Msty`. +6. If you are on AMD GPU, copy `rocm` folder to `C:\Users\\AppData\Roaming\Msty`. +7. Restart Msty and verify the version of Local AI service by going to `Settings` > `Local AI Service > Service Version`. + +**Note**: There is a small annoyance with the official build of Ollama where during chatting it opens up a blank Terminal window. You could just ignore it or wait for the latest +release of Msty. We have sent a PR to Ollama team and waiting for it to get merged. Please upvote this PR to get it prioritized: https://github.com/ollama/ollama/pull/4287 + + +## On Linux +1. Go to releases page on the Ollama repository: https://github.com/ollama/ollama/releases +2. From under `Assets`, download the latest version of Ollama for Linux by downloading the one appropriate for your system - either `ollama-linux-amd64` or `ollama-linux-arm64` +3. Once downloaded, copy it to `~/.config/Msty` and rename it as `msty-local` +4. Open Terminal and run the following command to make the file executable: +```bash +chmod +x ~/.config/Msty/msty-local +``` +5. Restart Msty and verify the version of Local AI service by going to `Settings` > `Local AI Service > Service Version`. +