[Documentation] Inference Platform Support #59

Closed
opened 2026-02-15 17:05:44 -05:00 by yindo · 2 comments
Owner

Originally created by @Siddhesh-Agarwal on GitHub (Jan 28, 2025).

It would be a good idea to add information about how to integrate inference platforms such as Groq, TogetherAI and DeepSeek in the docs. To integrate the above the procedure is:

Admin Panel -> Settings -> Connections -> Manage OpenAI API Connections -> Add Connection

Fill in the Base URL and API Key

The base URLs for the above providers are:

Originally created by @Siddhesh-Agarwal on GitHub (Jan 28, 2025). It would be a good idea to add information about how to integrate inference platforms such as [Groq](https://groq.com/), [TogetherAI](https://www.together.ai/) and [DeepSeek](https://www.deepseek.com/) in the docs. To integrate the above the procedure is: `Admin Panel` -> `Settings` -> `Connections` -> `Manage OpenAI API Connections` -> `Add Connection` Fill in the Base URL and API Key The base URLs for the above providers are: - Groq: https://api.groq.com/openai/v1 - TogetherAI: https://api.together.xyz/v1 - DeepSeek: https://api.deepseek.com/v1
yindo added the documentation label 2026-02-15 17:05:44 -05:00
yindo closed this issue 2026-02-15 17:05:44 -05:00
Author
Owner

@Classic298 commented on GitHub (Sep 14, 2025):

Hi, I think some improvements were made in the last weeks, which mention LiteLLM and OpenRouter as inference platforms, since both can act as a BYOK platforms - is there a need to add even more references?

In essence, the documentation already states that every platform with an OpenAI compatible endpoint should be supported.

@Classic298 commented on GitHub (Sep 14, 2025): Hi, I think some improvements were made in the last weeks, which mention LiteLLM and OpenRouter as inference platforms, since both can act as a BYOK platforms - is there a need to add even more references? In essence, the documentation already states that every platform with an OpenAI compatible endpoint should be supported.
Author
Owner

@Siddhesh-Agarwal commented on GitHub (Sep 14, 2025):

Hey! So when I created the PR, BYOK docs were not very clear. I figured out how to configure but then forgot to close this Issue. Sorry for the trouble I caused! Have a great day!

@Siddhesh-Agarwal commented on GitHub (Sep 14, 2025): Hey! So when I created the PR, BYOK docs were not very clear. I figured out how to configure but then forgot to close this Issue. Sorry for the trouble I caused! Have a great day!
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: open-webui/docs#59