Mintplex-Labs/anything-llm
1
0
Fork 0
mirror of https://github.com/Mintplex-Labs/anything-llm.git synced 2026-07-19 22:23:50 -04:00
Code Issues 328 Packages Projects Releases 10 Wiki Activity

[GH-ISSUE #1566] [FEAT]: Generic LLM provider preference #1013

New Issue
Closed
opened 2026-02-22 18:22:40 -05:00 by yindo · 3 comments
yindo commented 2026-02-22 18:22:40 -05:00
Owner
Copy Link
Copy Source

Originally created by @wcwong on GitHub (May 29, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/1566

What would you like to see?

I'd like to be able to create "generic" LLM providers. So, for example, Azure recently introduced pay as you go endpoints for other models where it's basically just a URL + API key with no other configuration bits.

Originally created by @wcwong on GitHub (May 29, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/1566 ### What would you like to see? I'd like to be able to create "generic" LLM providers. So, for example, Azure recently introduced pay as you go endpoints for other models where it's basically just a URL + API key with no other configuration bits.
yindo added the enhancementfeature request labels 2026-02-22 18:22:40 -05:00
yindo closed this issue 2026-02-22 18:22:40 -05:00
yindo commented 2026-02-22 18:22:40 -05:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (May 30, 2024):

This is the Generic OpenAI provider that we already support. Includes this exact kind of configuration and set up

@timothycarambat commented on GitHub (May 30, 2024): This is the Generic OpenAI provider that we already support. Includes this exact kind of configuration and set up
yindo commented 2026-02-22 18:22:40 -05:00
Author
Owner
Copy Link
Copy Source

@wcwong commented on GitHub (May 30, 2024):

Hi @timothycarambat. Thanks for the quick reply. The problem with the Generic OpenAI provider appears to be that it requires a model name. What if the endpoint does not accept the model name?

@wcwong commented on GitHub (May 30, 2024): Hi @timothycarambat. Thanks for the quick reply. The problem with the Generic OpenAI provider appears to be that it requires a model name. What if the endpoint does not accept the model name?
yindo commented 2026-02-22 18:22:40 -05:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (May 31, 2024):

You can just put anything, beccause then your API will probably just ignore it or drop it, like how LMStudio does

@timothycarambat commented on GitHub (May 31, 2024): You can just put anything, beccause then your API will probably just ignore it or drop it, like how LMStudio does
yindo changed title from [FEAT]: Generic LLM provider preference to [GH-ISSUE #1566] [FEAT]: Generic LLM provider preference 2026-06-05 14:38:28 -04:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Desktop
Docker
Integration Request
Integration Request
OS: Linux
OS: Mobile
OS: Windows
UI/UX
blocked
bug
bug
core-team-only
documentation
duplicate
embed-widget
enhancement
feature request
github_actions
good first issue
investigating
needs info / can't replicate
possible bug
pull-request
Mirrored from GitHub Pull Request
 question
stage: specifications
wontfix
No Label enhancement feature request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#1013
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?