[GH-ISSUE #517] "Could not respond to message" for Azure openAI #301

Closed
opened 2026-02-22 18:18:51 -05:00 by yindo · 3 comments
Owner

Originally created by @zhh210 on GitHub (Jan 3, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/517

I was following the documentation for Azure openAI. The chat UI always gives an error "Could not respond to message". Is there a way to see where the error is from? The web UI doesn't show anything other than the generic error msg.

Originally created by @zhh210 on GitHub (Jan 3, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/517 I was following the [documentation](https://docs.useanything.com/feature-overview/llm-selection/microsoft-azure) for Azure openAI. The chat UI always gives an error "Could not respond to message". Is there a way to see where the error is from? The web UI doesn't show anything other than the generic error msg.
yindo added the Integration Requestpossible bug labels 2026-02-22 18:18:51 -05:00
yindo closed this issue 2026-02-22 18:18:51 -05:00
Author
Owner

@timothycarambat commented on GitHub (Jan 3, 2024):

  • Open the docker container -> logs. You should see some type of error in the log once the chat had failed to send. This will help trace the error more easily.

  • Which model are you using?

  • What image tag are you using for the docker image?

@timothycarambat commented on GitHub (Jan 3, 2024): - Open the docker container -> logs. You should see some type of error in the log once the chat had failed to send. This will help trace the error more easily. - Which model are you using? - What image tag are you using for the docker image?
Author
Owner

@zhh210 commented on GitHub (Jan 3, 2024):

Thanks @timothycarambat, found the issue: The Azure Service Endpoint is actually referring to the api_base rather than the Endpoint of Azure's dashboard (which includes the preview version in the url). Now it works as expected on Azure (gpt-35-turbo) despite not providing the preview version.

@zhh210 commented on GitHub (Jan 3, 2024): Thanks @timothycarambat, found the issue: The `Azure Service Endpoint` is actually referring to the `api_base` rather than the `Endpoint` of Azure's dashboard (which includes the preview version in the url). Now it works as expected on Azure (gpt-35-turbo) despite not providing the preview version.
Author
Owner

@timothycarambat commented on GitHub (Jan 3, 2024):

Ah! That is a very subtle difference. I wonder if there is a way we can do some URL pattern matching to prevent that easy to make mistake.

@timothycarambat commented on GitHub (Jan 3, 2024): Ah! That is a very subtle difference. I wonder if there is a way we can do some URL pattern matching to prevent that easy to make mistake.
yindo changed title from "Could not respond to message" for Azure openAI to [GH-ISSUE #517] "Could not respond to message" for Azure openAI 2026-06-05 14:34:35 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#301