[GH-ISSUE #2882] [FEAT]: Custom /completions compatibility #1836

Closed
opened 2026-02-22 18:26:45 -05:00 by yindo · 0 comments
Owner

Originally created by @daaddd on GitHub (Dec 20, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2882

What would you like to see?

Hi there, some Cloud providers like Vultr provide /completions endpoints ready to roll and you can choose which open source LLM you wanna use. That's helpful because it allows customers to own the whole stack and meet compliance guidelines without exposing data to third party providers. Is it possible to use anything-llm with custom url /completions endpoints? At first glance it seems only major providers are supported, please advise, thank you!

image

Originally created by @daaddd on GitHub (Dec 20, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2882 ### What would you like to see? Hi there, some Cloud providers like Vultr provide /completions endpoints ready to roll and you can choose which open source LLM you wanna use. That's helpful because it allows customers to own the whole stack and meet compliance guidelines without exposing data to third party providers. Is it possible to use anything-llm with custom url /completions endpoints? At first glance it seems only major providers are supported, please advise, thank you! ![image](https://github.com/user-attachments/assets/79353370-8588-4b1f-b51b-e8b4e0124257)
yindo added the enhancementfeature request labels 2026-02-22 18:26:45 -05:00
yindo closed this issue 2026-02-22 18:26:45 -05:00
yindo changed title from [FEAT]: Custom /completions compatibility to [GH-ISSUE #2882] [FEAT]: Custom /completions compatibility 2026-06-05 14:42:57 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#1836