Mintplex-Labs/anything-llm
1
0
Fork 0
mirror of https://github.com/Mintplex-Labs/anything-llm.git synced 2026-07-19 14:13:35 -04:00
Code Issues 328 Packages Projects Releases 10 Wiki Activity

[GH-ISSUE #2551] [BUG]: can't use openai realtime api #1651

New Issue
Closed
opened 2026-02-22 18:25:53 -05:00 by yindo · 3 comments
yindo commented 2026-02-22 18:25:53 -05:00
Owner
Copy Link
Copy Source

Originally created by @japen0617 on GitHub (Oct 29, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2551

How are you running AnythingLLM?

Local development

What happened?

I chose the gpt-4o-realtime model in the workspace.
Then try to use it, but it shows the following error message
Could not respond to message.
404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/ completions
image1
image3
image2

Are there known steps to reproduce?

No response

Originally created by @japen0617 on GitHub (Oct 29, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2551 ### How are you running AnythingLLM? Local development ### What happened? I chose the gpt-4o-realtime model in the workspace. Then try to use it, but it shows the following error message Could not respond to message. 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/ completions ![image1](https://github.com/user-attachments/assets/b8c4c2a0-48e8-4098-9752-eba281080965) ![image3](https://github.com/user-attachments/assets/ee095cd9-b50b-4be8-b715-35275ae17895) ![image2](https://github.com/user-attachments/assets/1e1b53f7-2392-4967-a848-e1c1340ec9cf) ### Are there known steps to reproduce? _No response_
yindo added the possible bug label 2026-02-22 18:25:53 -05:00
yindo closed this issue 2026-02-22 18:25:53 -05:00
yindo commented 2026-02-22 18:25:53 -05:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (Oct 29, 2024):

Correct, dont use realtime as your model - we dont have support for it currently since it cannot handle chat message pairs

@timothycarambat commented on GitHub (Oct 29, 2024): Correct, dont use realtime as your model - we dont have support for it currently since it cannot handle chat message pairs
yindo commented 2026-02-22 18:25:53 -05:00
Author
Owner
Copy Link
Copy Source

@lwiart commented on GitHub (Nov 14, 2024):

Hello,

Same for me, I just installed AnythingLLM (1.6.9), chose OpenAI and pasted an API Key.
But found why :

  • In the global settings for AnythingLLM : I chose OpenAI and gpt-4o-realtime-preview-....
  • Created a workspace in which I configured OpenAI and gpt-4o
  • When I was trying to chat in that workspace, no matter which model I choose, I got "Could not respond to message.
    404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions?"
  • Then I went back to the global settings for AnythingLLM and chose got-4o
  • Then chat worked in my workspace
    => it seems that the workspace config for model is not used and it's the global setting that gets used.

Normal ?

image

PS: other than that, AnythingLLM is awesome!

@lwiart commented on GitHub (Nov 14, 2024): Hello, Same for me, I just installed AnythingLLM (1.6.9), chose OpenAI and pasted an API Key. But found why : - In the global settings for AnythingLLM : I chose OpenAI and gpt-4o-realtime-preview-.... - Created a workspace in which I configured OpenAI and gpt-4o - When I was trying to chat in that workspace, no matter which model I choose, I got "Could not respond to message. 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions?" - Then I went back to the global settings for AnythingLLM and chose got-4o - Then chat worked in my workspace => it seems that the workspace config for model is not used and it's the global setting that gets used. Normal ? ![image](https://github.com/user-attachments/assets/8c8b2ca0-ca0c-46b3-a444-926cccf32a44) PS: other than that, AnythingLLM is awesome!
yindo commented 2026-02-22 18:25:54 -05:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (Nov 15, 2024):

While realtime is available in the dropdown (we dont filter) support for it needs to still be built out since it works quite differently from the traditional API - that is why it is broken. Realtime is pretty different from the normal API/chunk response.

In the interim, swap to just another model that works in the traditional sense (basically any model that isn't realtime)

@timothycarambat commented on GitHub (Nov 15, 2024): While realtime is available in the dropdown (we dont filter) support for it needs to still be built out since it works quite differently from the traditional API - that is why it is broken. Realtime is pretty different from the normal API/chunk response. In the interim, swap to just another model that works in the traditional sense (basically any model that isn't realtime)
yindo changed title from [BUG]: can't use openai realtime api to [GH-ISSUE #2551] [BUG]: can't use openai realtime api 2026-06-05 14:41:57 -04:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Desktop
Docker
Integration Request
Integration Request
OS: Linux
OS: Mobile
OS: Windows
UI/UX
blocked
bug
bug
core-team-only
documentation
duplicate
embed-widget
enhancement
feature request
github_actions
good first issue
investigating
needs info / can't replicate
possible bug
pull-request
Mirrored from GitHub Pull Request
 question
stage: specifications
wontfix
No Label possible bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#1651
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?