[GH-ISSUE #4485] [BUG]: All Cohere's models not valid for chat completion! #2855

Closed
opened 2026-02-22 18:31:32 -05:00 by yindo · 5 comments
Owner

Originally created by @khalilxg on GitHub (Oct 3, 2025).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/4485

How are you running AnythingLLM?

Docker (local)

What happened?

So recently cohere updated all their models, since latest days of 08-2025, now nothing works, all msgs through api and Chat GUI returns "this model is not valid for chat completion!"

tested models are:
-command-a-03-2025
-command-r7b-12-2024
-command-r-08-2024
-command-r-plus-08-2024
--command-r-03-2024 and other old models not live anymore

Are there known steps to reproduce?

-send msg through api / chat GUI

Originally created by @khalilxg on GitHub (Oct 3, 2025). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/4485 ### How are you running AnythingLLM? Docker (local) ### What happened? So recently cohere updated all their models, since latest days of 08-2025, now nothing works, all msgs through api and Chat GUI returns "this model is not valid for chat completion!" tested models are: -command-a-03-2025 -command-r7b-12-2024 -command-r-08-2024 -command-r-plus-08-2024 --command-r-03-2024 and other old models not live anymore ### Are there known steps to reproduce? -send msg through api / chat GUI
yindo added the possible bug label 2026-02-22 18:31:32 -05:00
yindo closed this issue 2026-02-22 18:31:32 -05:00
Author
Owner

@khalilxg commented on GitHub (Oct 3, 2025):

i think its endpoint issue, chatcompetition is now chat

@khalilxg commented on GitHub (Oct 3, 2025): i think its endpoint issue, chatcompetition is now chat
Author
Owner

@timothycarambat commented on GitHub (Oct 3, 2025):

This was due to the fact we have not upgraded cohere in a while. Patched for basic chat in #4489, will need to also do in #4490

@timothycarambat commented on GitHub (Oct 3, 2025): This was due to the fact we have not upgraded cohere in a while. Patched for basic chat in #4489, will need to also do in #4490
Author
Owner

@khalilxg commented on GitHub (Oct 3, 2025):

cohere chat works now perfectly on "Generic OpenAi"

@khalilxg commented on GitHub (Oct 3, 2025): cohere chat works now perfectly on "Generic OpenAi"
Author
Owner

@khalilxg commented on GitHub (Nov 14, 2025):

update: my cloud provider hosting at Huawei china, now im getting "Could not respond to message.
Connection error." its a geo-restriction. Only OpenAI and Anthropic are bloquing China but not Cohere, Maybe Cohere has bloqued China either icant find a way to test is api cnx if bloqued or not, and i dont want to use vpn or proxies cuz my app is free and the usage is hight so the latency will go biiig. Any ideas ?

@khalilxg commented on GitHub (Nov 14, 2025): update: my cloud provider hosting at Huawei china, now im getting "Could not respond to message. Connection error." its a geo-restriction. Only OpenAI and Anthropic are bloquing China but not Cohere, Maybe Cohere has bloqued China either icant find a way to test is api cnx if bloqued or not, and i dont want to use vpn or proxies cuz my app is free and the usage is hight so the latency will go biiig. Any ideas ?
Author
Owner

@khalilxg commented on GitHub (Nov 15, 2025):

cohere models are update, thank you

@khalilxg commented on GitHub (Nov 15, 2025): cohere models are update, thank you
yindo changed title from [BUG]: All Cohere's models not valid for chat completion! to [GH-ISSUE #4485] [BUG]: All Cohere's models not valid for chat completion! 2026-06-05 14:48:54 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#2855