mirror of
https://github.com/cloudstack-llc/msty-docs.git
synced 2026-07-18 18:54:38 -04:00
docs: add custom models
This commit is contained in:
@@ -0,0 +1,46 @@
|
||||
---
|
||||
title: Add Models Not Included in Registry
|
||||
description: Add models that are not included in the model registry to Msty
|
||||
---
|
||||
|
||||
Msty comes with a model registry that includes a variety of models from different providers. We also regularly update the registry with new models, which you can fetch without updating the app.
|
||||
First make sure to get the latest models info by going to `Settings` -> `General` -> `Models Info` > `Fetch Models Info`.
|
||||
|
||||
If the model you want to use is still not available, you can add it manually. This guide will show you how to add models that are not included in the model registry.
|
||||
|
||||
Follow the steps below to add a new model
|
||||
|
||||
::steps
|
||||
### Open Settings
|
||||
Open settings from the sidebar.
|
||||
|
||||
::image-plain{src="/how-to/use-sambanova-models/open-settings.webp" alt="Open Settings"}
|
||||
::
|
||||
|
||||
### Go to Remote Model Providers
|
||||
|
||||
From the options, click Remote Model Providers.
|
||||
|
||||
::image-plain{src="/how-to/use-sambanova-models/remote-model-providers.webp" alt="Go to Remote Model Providers"}
|
||||
::
|
||||
|
||||
### Add New Provider
|
||||
Click on Add New Provider button from the top right corner. Or if you have already added a provider, click Edit icon next to the provider to add a new model.
|
||||
|
||||
::image-plain{src="/how-to/use-sambanova-models/add-new-provider.webp" alt="Add New Provider"}
|
||||
::
|
||||
|
||||
### Add a Model
|
||||
You can add any models as necessary. You just need to get the id of the model from the provider such as `chatgpt-4o-latest`. Here, we are adding `Meta-Llama-3.1-405B-Instruct` as a custom model from SambaNova but process is exactly the same for other providers.
|
||||
|
||||
Once you are done adding models, click the Add button on the bottom right.
|
||||
|
||||
::image-plain{src="/how-to/use-sambanova-models/add-a-custom-model.webp" alt="Add a Model"}
|
||||
::
|
||||
|
||||
### Start Chatting
|
||||
From the model selector in a new chat, select the model that you just added and start chatting.
|
||||
|
||||
::image-plain{src="/how-to/use-sambanova-models/start-chatting.webp" alt="Start Chatting"}
|
||||
::
|
||||
::
|
||||
@@ -61,9 +61,9 @@ Follow the steps below to add and use the SambaNova models in Msty.
|
||||
|
||||
You can choose to add any or all of the following models:
|
||||
|
||||
- Meta-Llama-3.1-8B-Instruct
|
||||
- Meta-Llama-3.1-70B-Instruct
|
||||
- Meta-Llama-3.1-405B-Instruct
|
||||
- `Meta-Llama-3.1-8B-Instruct`
|
||||
- `Meta-Llama-3.1-70B-Instruct`
|
||||
- `Meta-Llama-3.1-405B-Instruct`
|
||||
|
||||
Once you are done adding models, click the Add button on the bottom right.
|
||||
|
||||
@@ -75,4 +75,4 @@ Follow the steps below to add and use the SambaNova models in Msty.
|
||||
|
||||
::image-plain{src="/how-to/use-sambanova-models/start-chatting.webp" alt="Start Chatting"}
|
||||
::
|
||||
::
|
||||
::
|
||||
|
||||
Reference in New Issue
Block a user