mirror of
https://github.com/open-webui/docs.git
synced 2026-07-20 15:38:19 -04:00
[Documentation] Inference Platform Support #59
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @Siddhesh-Agarwal on GitHub (Jan 28, 2025).
It would be a good idea to add information about how to integrate inference platforms such as Groq, TogetherAI and DeepSeek in the docs. To integrate the above the procedure is:
Admin Panel->Settings->Connections->Manage OpenAI API Connections->Add ConnectionFill in the Base URL and API Key
The base URLs for the above providers are:
@Classic298 commented on GitHub (Sep 14, 2025):
Hi, I think some improvements were made in the last weeks, which mention LiteLLM and OpenRouter as inference platforms, since both can act as a BYOK platforms - is there a need to add even more references?
In essence, the documentation already states that every platform with an OpenAI compatible endpoint should be supported.
@Siddhesh-Agarwal commented on GitHub (Sep 14, 2025):
Hey! So when I created the PR, BYOK docs were not very clear. I figured out how to configure but then forgot to close this Issue. Sorry for the trouble I caused! Have a great day!