[GH-ISSUE #2579] [BUG]: Failed to analyze images using OpenAI api #1674

Closed
opened 2026-02-22 18:25:59 -05:00 by yindo · 1 comment
Owner

Originally created by @Jason202268 on GitHub (Nov 3, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2579

How are you running AnythingLLM?

AnythingLLM desktop app

What happened?

When I uploaded images, the response is just like, "I'm sorry, but I can't process images directly. However, you can use OCR (Optical Character Recognition) software or apps to extract text from photos. Would you like recommendations for some OCR tools?"

Are there known steps to reproduce?

No response

Originally created by @Jason202268 on GitHub (Nov 3, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2579 ### How are you running AnythingLLM? AnythingLLM desktop app ### What happened? When I uploaded images, the response is just like, "I'm sorry, but I can't process images directly. However, you can use OCR (Optical Character Recognition) software or apps to extract text from photos. Would you like recommendations for some OCR tools?" ### Are there known steps to reproduce? _No response_
yindo added the possible bug label 2026-02-22 18:25:59 -05:00
yindo closed this issue 2026-02-22 18:25:59 -05:00
Author
Owner

@timothycarambat commented on GitHub (Nov 4, 2024):

This is an LLM refusal, not an AnythingLLM error. The LLM probably does not support vision or is hallunicating
Currently for OpenAI only a few models support vision and if it is supported, we pass through the image.
https://github.com/Mintplex-Labs/anything-llm/blob/0bb47619dcdbbfc6af8a1c0e9a8b4e3d1b6f99bb/server/utils/AiProviders/openAi/index.js#L80-L95

@timothycarambat commented on GitHub (Nov 4, 2024): This is an LLM refusal, not an AnythingLLM error. The LLM probably does not support vision or is hallunicating Currently for OpenAI only a few models support vision and if it is supported, we pass through the image. https://github.com/Mintplex-Labs/anything-llm/blob/0bb47619dcdbbfc6af8a1c0e9a8b4e3d1b6f99bb/server/utils/AiProviders/openAi/index.js#L80-L95
yindo changed title from [BUG]: Failed to analyze images using OpenAI api to [GH-ISSUE #2579] [BUG]: Failed to analyze images using OpenAI api 2026-06-05 14:42:03 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#1674