Mintplex-Labs/anything-llm
1
0
Fork 0
mirror of https://github.com/Mintplex-Labs/anything-llm.git synced 2026-07-19 14:13:35 -04:00
Code Issues 328 Packages Projects Releases 10 Wiki Activity

[GH-ISSUE #1167] [FEAT]: Add New OpenAI model to Workspace Agent LLM provider and ability to enter any model name #718

New Issue
Closed
opened 2026-02-22 18:20:59 -05:00 by yindo · 6 comments
yindo commented 2026-02-22 18:20:59 -05:00
Owner
Copy Link
Copy Source

Originally created by @Neoony on GitHub (Apr 22, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/1167

What would you like to see?

Add new OpenAI model to Workspace Agent LLM provider:
Model: gpt-4-turbo-2024-04-09

Pointer to the latest version: gpt-4-turbo

However, this needs to manually happen every time they add or update models.

Why not either grab the models list from the API, or just give ability to write any model name?
And then this is maintenance free?

Thanks!

Originally created by @Neoony on GitHub (Apr 22, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/1167 ### What would you like to see? Add new OpenAI model to Workspace Agent LLM provider: Model: gpt-4-turbo-2024-04-09 Pointer to the latest version: gpt-4-turbo However, this needs to manually happen every time they add or update models. Why not either grab the models list from the API, or just give ability to write any model name? And then this is maintenance free? Thanks!
yindo added the enhancementfeature request labels 2026-02-22 18:21:00 -05:00
yindo closed this issue 2026-02-22 18:21:00 -05:00
yindo commented 2026-02-22 18:21:00 -05:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (Apr 22, 2024):

We do this already (because of that issue you outlined).
https://github.com/Mintplex-Labs/anything-llm/blob/7e3b8cd4fcde0a7c66918842222de476bc58b8d0/server/utils/helpers/customModels.js#L44

This is the server-side function that fetches all models from Openai + user-profile fine tunes.

@timothycarambat commented on GitHub (Apr 22, 2024): We do this already (because of that issue you outlined). https://github.com/Mintplex-Labs/anything-llm/blob/7e3b8cd4fcde0a7c66918842222de476bc58b8d0/server/utils/helpers/customModels.js#L44 This is the server-side function that fetches all models from Openai + user-profile fine tunes.
yindo commented 2026-02-22 18:21:00 -05:00
Author
Owner
Copy Link
Copy Source

@Neoony commented on GitHub (Apr 22, 2024):

So, why is it not on the list?

v1.5.0
https://i.imgur.com/BjbJpEv.png

OpenAI Playground:
https://i.imgur.com/TEtcqHq.png

I am using that model everywhere else

@Neoony commented on GitHub (Apr 22, 2024): So, why is it not on the list? v1.5.0 ![https://i.imgur.com/BjbJpEv.png](https://i.imgur.com/BjbJpEv.png) OpenAI Playground: ![https://i.imgur.com/TEtcqHq.png](https://i.imgur.com/TEtcqHq.png) I am using that model everywhere else
yindo commented 2026-02-22 18:21:00 -05:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (Apr 22, 2024):

Shows up for me

Docker
Screenshot 2024-04-22 at 3 01 23 PM

Desktop 1.5
Screenshot 2024-04-22 at 3 02 12 PM

@timothycarambat commented on GitHub (Apr 22, 2024): Shows up for me Docker <img width="768" alt="Screenshot 2024-04-22 at 3 01 23 PM" src="https://github.com/Mintplex-Labs/anything-llm/assets/16845892/535819dd-20f2-4cc9-ac7c-4a96e41d3e1b"> Desktop 1.5 <img width="803" alt="Screenshot 2024-04-22 at 3 02 12 PM" src="https://github.com/Mintplex-Labs/anything-llm/assets/16845892/c840526c-9f6c-4a56-84b0-acd6e31791dc">
yindo commented 2026-02-22 18:21:00 -05:00
Author
Owner
Copy Link
Copy Source

@Neoony commented on GitHub (Apr 22, 2024):

in Chat Settings, I was just using System default (using LM Studio)

If I select OpenAI there, the model shows up
image

But if I go to the Agent Config
Its not there:
image

huh?

@Neoony commented on GitHub (Apr 22, 2024): in Chat Settings, I was just using System default (using LM Studio) If I select OpenAI there, the model shows up ![image](https://github.com/Mintplex-Labs/anything-llm/assets/24975075/04cd8212-fd17-4d51-8f62-e50a12d95032) But if I go to the Agent Config Its not there: ![image](https://github.com/Mintplex-Labs/anything-llm/assets/24975075/a4a4e985-7f80-4ff9-b001-c59310b1edca) huh?
yindo commented 2026-02-22 18:21:00 -05:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (Apr 22, 2024):

gpt-4-2024-04-09 does not work with tool-calling. It is intentionally omitted to prevent people from filing issues saying it is broken when it is not supported even when OpenAI docs say it is. We tested it explicitly, but it does not work and says that function is not available via the API.

This is where we intentionally omit it while it is unavailable: https://github.com/Mintplex-Labs/anything-llm/blob/b50f1e747908085bd12dccc94cdb8ee15353fd88/frontend/src/pages/WorkspaceSettings/AgentConfig/AgentModelSelection/index.jsx#L9

@timothycarambat commented on GitHub (Apr 22, 2024): gpt-4-2024-04-09 does not work with tool-calling. It is intentionally omitted to prevent people from filing issues saying it is broken when it is not supported [even when OpenAI docs say it is](https://platform.openai.com/docs/guides/function-calling). We tested it explicitly, but it does not work and says that function is not available via the API. This is where we intentionally omit it while it is unavailable: https://github.com/Mintplex-Labs/anything-llm/blob/b50f1e747908085bd12dccc94cdb8ee15353fd88/frontend/src/pages/WorkspaceSettings/AgentConfig/AgentModelSelection/index.jsx#L9
yindo commented 2026-02-22 18:21:00 -05:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (Apr 22, 2024):

gpt-4-turbo-preview does work, for some reason.

@timothycarambat commented on GitHub (Apr 22, 2024): gpt-4-turbo-preview _does_ work, for some reason.
yindo changed title from [FEAT]: Add New OpenAI model to Workspace Agent LLM provider and ability to enter any model name to [GH-ISSUE #1167] [FEAT]: Add New OpenAI model to Workspace Agent LLM provider and ability to enter any model name 2026-06-05 14:36:50 -04:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Desktop
Docker
Integration Request
Integration Request
OS: Linux
OS: Mobile
OS: Windows
UI/UX
blocked
bug
bug
core-team-only
documentation
duplicate
embed-widget
enhancement
feature request
github_actions
good first issue
investigating
needs info / can't replicate
possible bug
pull-request
Mirrored from GitHub Pull Request
 question
stage: specifications
wontfix
No Label enhancement feature request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#718
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?