[GH-ISSUE #4812] [BUG]: Could not respond to message. 503 status code (no body) #3029

Closed
opened 2026-02-22 18:32:19 -05:00 by yindo · 1 comment
Owner

Originally created by @lucas150670 on GitHub (Dec 28, 2025).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/4812

How are you running AnythingLLM?

AnythingLLM desktop app

What happened?

When I tried to run AnythingLLM v1.9.1 on Windows 11 25H2 ARM (10.0.26200.7462) on Acer SFA11-14 (X Elite X1E-78-100), with models download:

  • QNN/llama_v3_1_8b_chat_8k
  • QNN/llama_v3_2_3b_chat_16k
  • QNN/phi_3_5_mini_instruct_4k

All these models can reproduce this error.
Here is the log for the error:

backend-2025-12-28.log
collector-2025-12-28.log

Are there known steps to reproduce?

  • Open the app
  • Parse something into the input box
  • Click "Send"
Originally created by @lucas150670 on GitHub (Dec 28, 2025). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/4812 ### How are you running AnythingLLM? AnythingLLM desktop app ### What happened? When I tried to run AnythingLLM v1.9.1 on Windows 11 25H2 ARM (10.0.26200.7462) on Acer SFA11-14 (X Elite X1E-78-100), with models download: - QNN/llama_v3_1_8b_chat_8k - QNN/llama_v3_2_3b_chat_16k - QNN/phi_3_5_mini_instruct_4k All these models can reproduce this error. Here is the log for the error: [backend-2025-12-28.log](https://github.com/user-attachments/files/24358879/backend-2025-12-28.log) [collector-2025-12-28.log](https://github.com/user-attachments/files/24358878/collector-2025-12-28.log) ### Are there known steps to reproduce? - Open the app - Parse something into the input box - Click "Send"
yindo added the possible bug label 2026-02-22 18:32:19 -05:00
yindo closed this issue 2026-02-22 18:32:19 -05:00
Author
Owner

@timothycarambat commented on GitHub (Jan 2, 2026):

This error can occur in a brief timeframe between the API responding and the model being accecpted by the underlying qualcomm SDK as "loaded." if you resend the message, it should succeed.

Do you consistently get this every single request, even after waiting a few moments?

@timothycarambat commented on GitHub (Jan 2, 2026): This error can occur in a brief timeframe between the API responding and the model being accecpted by the underlying qualcomm SDK as "loaded." if you resend the message, it should succeed. Do you consistently get this every single request, even after waiting a few moments?
yindo changed title from [BUG]: Could not respond to message. 503 status code (no body) to [GH-ISSUE #4812] [BUG]: Could not respond to message. 503 status code (no body) 2026-06-05 14:49:55 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#3029