Mintplex-Labs/anything-llm
1
0
Fork 0
mirror of https://github.com/Mintplex-Labs/anything-llm.git synced 2026-07-19 14:13:35 -04:00
Code Issues 328 Packages Projects Releases 10 Wiki Activity

[GH-ISSUE #5525] [BUG]: Anything LLM rejects DeepSeek V4 Flash as chat model — "deepseek-chat is not valid for chat completion" #5146

New Issue
Closed
opened 2026-06-05 14:52:17 -04:00 by yindo · 2 comments
yindo commented 2026-06-05 14:52:17 -04:00
Owner
Copy Link
Copy Source

Originally created by @craudiomilho on GitHub (Apr 24, 2026).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/5525

How are you running AnythingLLM?

AnythingLLM desktop app

What happened?

I'm trying to load DeepSeek V4 Flash into Anything LLM and use it for chat completions, but the runtime fails with:

"Could not respond to message."
"DeepSeek chat: deepseek-chat is not valid for chat completion!"
Expected behavior:
Anything LLM should accept a chat-capable DeepSeek model and allow chat completions.

The error suggests the model is being treated as a chat model but the loaded artifact does not expose the chat completion interface the runtime expects.

Are there known steps to reproduce?

Download DeepSeek V4 Flash model artifacts
Configure Anything LLM to use the model as a chat model (model name: deepseek-v4-pro / deepseek-v4-flash-chat).
Send a chat completion request through the Anything LLM interface.

LLM Provider & Model (if applicable)

Anything LLM version: 1.12.0 Ubuntu
Model artifact variant tested: DeepSeek V4 Flash, DeepSeek V4 Pro

Embedder Provider & Model (if applicable)

No response

Originally created by @craudiomilho on GitHub (Apr 24, 2026). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/5525 ### How are you running AnythingLLM? AnythingLLM desktop app ### What happened? I'm trying to load DeepSeek V4 Flash into Anything LLM and use it for chat completions, but the runtime fails with: "Could not respond to message." "DeepSeek chat: deepseek-chat is not valid for chat completion!" Expected behavior: Anything LLM should accept a chat-capable DeepSeek model and allow chat completions. The error suggests the model is being treated as a chat model but the loaded artifact does not expose the chat completion interface the runtime expects. ### Are there known steps to reproduce? Download DeepSeek V4 Flash model artifacts Configure Anything LLM to use the model as a chat model (model name: deepseek-v4-pro / deepseek-v4-flash-chat). Send a chat completion request through the Anything LLM interface. ### LLM Provider & Model (if applicable) Anything LLM version: 1.12.0 Ubuntu Model artifact variant tested: DeepSeek V4 Flash, DeepSeek V4 Pro ### Embedder Provider & Model (if applicable) _No response_
yindo added the possible bug label 2026-06-05 14:52:17 -04:00
yindo closed this issue 2026-06-05 14:52:17 -04:00
yindo commented 2026-06-05 14:52:17 -04:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (Apr 24, 2026):

https://github.com/Mintplex-Labs/anything-llm/issues/5523#issuecomment-4316708645

Moving to #5509

<!-- gh-comment-id:4316711222 --> @timothycarambat commented on GitHub (Apr 24, 2026): https://github.com/Mintplex-Labs/anything-llm/issues/5523#issuecomment-4316708645 Moving to #5509
yindo commented 2026-06-05 14:52:17 -04:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (Apr 24, 2026):

Note: If you manually set the DEEPSEEK_MODEL_PREF ENV in the appropriate env file location
Docker - this is in your storage folder you use with the container
Desktop- https://docs.anythingllm.com/installation-desktop/storage should be potentially invisible .env file.

Edit this file, restart container or kill & restart app.

This will allow you to still use these deprecated models despite the fact the Deepseek official API does not show them - everything will still work while we work on https://github.com/Mintplex-Labs/anything-llm/issues/5509 for official support and also bringing that patch to desktop!

Valid values for legacy models are:
deepseek-reasoner or deepseek-chat

<!-- gh-comment-id:4316798470 --> @timothycarambat commented on GitHub (Apr 24, 2026): Note: If you manually set the DEEPSEEK_MODEL_PREF ENV in the appropriate env file location Docker - this is in your storage folder you use with the container Desktop- https://docs.anythingllm.com/installation-desktop/storage should be potentially invisible .env file. Edit this file, restart container or kill & restart app. This will allow you to still use these deprecated models despite the fact the Deepseek official API does not show them - everything will still work while we work on https://github.com/Mintplex-Labs/anything-llm/issues/5509 for official support and also bringing that patch to desktop! Valid values for legacy models are: `deepseek-reasoner` or `deepseek-chat`
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Desktop
Docker
Integration Request
Integration Request
OS: Linux
OS: Mobile
OS: Windows
UI/UX
blocked
bug
bug
core-team-only
documentation
duplicate
embed-widget
enhancement
feature request
github_actions
good first issue
investigating
needs info / can't replicate
possible bug
pull-request
Mirrored from GitHub Pull Request
 question
stage: specifications
wontfix
No Label possible bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#5146
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?