Merge branch 'dev' into prod

This commit is contained in:
Ashok Gelal
2024-09-20 10:06:45 -04:00
2 changed files with 50 additions and 4 deletions
@@ -0,0 +1,46 @@
---
title: Add Models Not Included in Registry
description: Add models that are not included in the model registry to Msty
---
Msty comes with a model registry that includes a variety of models from different providers. We also regularly update the registry with new models, which you can fetch without updating the app.
First make sure to get the latest models info by going to `Settings` -> `General` -> `Models Info` > `Fetch Models Info`.
If the model you want to use is still not available, you can add it manually. This guide will show you how to add models that are not included in the model registry.
Follow the steps below to add a new model
::steps
### Open Settings
Open settings from the sidebar.
::image-plain{src="/how-to/use-sambanova-models/open-settings.webp" alt="Open Settings"}
::
### Go to Remote Model Providers
From the options, click Remote Model Providers.
::image-plain{src="/how-to/use-sambanova-models/remote-model-providers.webp" alt="Go to Remote Model Providers"}
::
### Add New Provider
Click on Add New Provider button from the top right corner. Or if you have already added a provider, click Edit icon next to the provider to add a new model.
::image-plain{src="/how-to/use-sambanova-models/add-new-provider.webp" alt="Add New Provider"}
::
### Add a Model
You can add any models as necessary. You just need to get the id of the model from the provider such as `chatgpt-4o-latest`. Here, we are adding `Meta-Llama-3.1-405B-Instruct` as a custom model from SambaNova but process is exactly the same for other providers.
Once you are done adding models, click the Add button on the bottom right.
::image-plain{src="/how-to/use-sambanova-models/add-a-custom-model.webp" alt="Add a Model"}
::
### Start Chatting
From the model selector in a new chat, select the model that you just added and start chatting.
::image-plain{src="/how-to/use-sambanova-models/start-chatting.webp" alt="Start Chatting"}
::
::
@@ -61,9 +61,9 @@ Follow the steps below to add and use the SambaNova models in Msty.
You can choose to add any or all of the following models:
- Meta-Llama-3.1-8B-Instruct
- Meta-Llama-3.1-70B-Instruct
- Meta-Llama-3.1-405B-Instruct
- `Meta-Llama-3.1-8B-Instruct`
- `Meta-Llama-3.1-70B-Instruct`
- `Meta-Llama-3.1-405B-Instruct`
Once you are done adding models, click the Add button on the bottom right.
@@ -75,4 +75,4 @@ Follow the steps below to add and use the SambaNova models in Msty.
::image-plain{src="/how-to/use-sambanova-models/start-chatting.webp" alt="Start Chatting"}
::
::
::