Mintplex-Labs/anything-llm
1
0
Fork 0
mirror of https://github.com/Mintplex-Labs/anything-llm.git synced 2026-07-19 14:13:35 -04:00
Code Issues 328 Packages Projects Releases 10 Wiki Activity

[GH-ISSUE #2914] [BUG]: Only user and assistant roles are supported!. - (When I try to use anythingllm with lm studio) #1857

New Issue
Closed
opened 2026-02-22 18:26:51 -05:00 by yindo · 1 comment
yindo commented 2026-02-22 18:26:51 -05:00
Owner
Copy Link
Copy Source

Originally created by @winterchan2138 on GitHub (Dec 30, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2914

How are you running AnythingLLM?

AnythingLLM desktop app

What happened?

I try to use AnythingLLM with LM Studio and mistral-7b-instruct-v0.3 model

I get this error on lm studio server console:

2024-12-30 14:06:38 [ERROR] Only user and assistant roles are supported!. Error Data: n/a, Additional Data: n/a
In anythingllm i get:

Could not respond to message.
(no status code or body)

image

In the inference tab i don't have any built in presets
image

In code Snippet tab, over at the chat sub-tab

image

I can see the problematic part, but it cannot be changed, i don't know how to find or change it at all.

How can i solve this problem?

Are there known steps to reproduce?

1-Download Lm Studio and install mistral-7b-instruct-v0.3
2-Run the server without any further changes
image

3-Download AnythingLLM and let it auto detect the server.
4-Create a new Workspace and try to chat.
5-You get this error:
Could not respond to message.
(no status code or body)
image

Originally created by @winterchan2138 on GitHub (Dec 30, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2914 ### How are you running AnythingLLM? AnythingLLM desktop app ### What happened? **I try to use AnythingLLM with LM Studio and mistral-7b-instruct-v0.3 model** I get this error on lm studio server console: `2024-12-30 14:06:38 [ERROR] Only user and assistant roles are supported!. Error Data: n/a, Additional Data: n/a ` In anythingllm i get: ``` Could not respond to message. (no status code or body) ``` ![image](https://github.com/user-attachments/assets/3ab8d563-46c7-43ec-a96e-ae2093055628) In the inference tab i don't have any built in presets ![image](https://github.com/user-attachments/assets/5a43fb10-5ef4-4231-b468-8a3aaf9d890f) In code Snippet tab, over at the chat sub-tab ![image](https://github.com/user-attachments/assets/fc1eadb1-6250-476d-852f-464dd02d8757) I can see the problematic part, but it cannot be changed, i don't know how to find or change it at all. How can i solve this problem? ### Are there known steps to reproduce? 1-Download Lm Studio and install mistral-7b-instruct-v0.3 2-Run the server without any further changes ![image](https://github.com/user-attachments/assets/50dffecf-0720-4e75-b91e-08421042d494) 3-Download AnythingLLM and let it auto detect the server. 4-Create a new Workspace and try to chat. 5-You get this error: Could not respond to message. (no status code or body) ![image](https://github.com/user-attachments/assets/84e88842-1d84-4d61-b804-923ff0f74d70)
yindo added the possible bug label 2026-02-22 18:26:51 -05:00
yindo closed this issue 2026-02-22 18:26:51 -05:00
yindo commented 2026-02-22 18:26:51 -05:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (Dec 30, 2024):

This is the LMStudio configuration issue, not anythingLLM: https://github.com/Mintplex-Labs/anything-llm/issues/2837#issuecomment-2549947359

As you have already shown you are using a template named Mistral but where did this template come from and what does it look like? The detail here is LMStudio automatically reformats incoming requests into the prompt, which since system does not exist, augments our requests to work with Mistral. Something appears to be wrong with the template or the template is not applying to incoming requests

@timothycarambat commented on GitHub (Dec 30, 2024): This is the LMStudio configuration issue, not anythingLLM: https://github.com/Mintplex-Labs/anything-llm/issues/2837#issuecomment-2549947359 As you have already shown you are using a template named `Mistral` but where did this template come from and what does it look like? The detail here is LMStudio automatically reformats incoming requests into the prompt, which since system does not exist, augments our requests to work with Mistral. Something appears to be wrong with the template or the template is not applying to incoming requests
yindo changed title from [BUG]: Only user and assistant roles are supported!. - (When I try to use anythingllm with lm studio) to [GH-ISSUE #2914] [BUG]: Only user and assistant roles are supported!. - (When I try to use anythingllm with lm studio) 2026-06-05 14:43:05 -04:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Desktop
Docker
Integration Request
Integration Request
OS: Linux
OS: Mobile
OS: Windows
UI/UX
blocked
bug
bug
core-team-only
documentation
duplicate
embed-widget
enhancement
feature request
github_actions
good first issue
investigating
needs info / can't replicate
possible bug
pull-request
Mirrored from GitHub Pull Request
 question
stage: specifications
wontfix
No Label possible bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#1857
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?