Mintplex-Labs/anything-llm
1
0
Fork 0
mirror of https://github.com/Mintplex-Labs/anything-llm.git synced 2026-07-19 14:13:35 -04:00
Code Issues 328 Packages Projects Releases 10 Wiki Activity

[GH-ISSUE #2342] [FEAT]: Add pixtral vision capabilities #1529

New Issue
Closed
opened 2026-02-22 18:25:16 -05:00 by yindo · 3 comments
yindo commented 2026-02-22 18:25:16 -05:00
Owner
Copy Link
Copy Source

Originally created by @nekopep on GitHub (Sep 21, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2342

What would you like to see?

Currenlty we are able to select new MistralAi Pixtral 12b model.

This model is a multimodal model specialized in image analysis. In latest AnythingLLM 1.2.2 we can upload image but we need the send the image to pixtral in base64 in the request.

messages = [
# Define the messages for the chat
messages = [
    {
        "role": "user",
        "content": [
            {
                "type": "text",
                "text": "What's in this image?"
            },
            {
                "type": "image_url"
                "image_url": f"data:image/jpeg;base64,{base64_image}"
            }
        ]
    }
]

It can be used to transcribe image (OCR) see example in image below. You can even compare two images.

I could be very cool to add this feature to anythingLLM :)

Doc about the feature:
https://docs.mistral.ai/capabilities/vision/#passing-a-base64-encoded-image

Originally created by @nekopep on GitHub (Sep 21, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2342 ### What would you like to see? Currenlty we are able to select new MistralAi Pixtral 12b model. This model is a multimodal model specialized in image analysis. In latest AnythingLLM 1.2.2 we can upload image but we need the send the image to pixtral in base64 in the request. ``` messages = [ # Define the messages for the chat messages = [ { "role": "user", "content": [ { "type": "text", "text": "What's in this image?" }, { "type": "image_url" "image_url": f"data:image/jpeg;base64,{base64_image}" } ] } ] ``` It can be used to transcribe image (OCR) see example in image below. You can even compare two images. I could be very cool to add this feature to anythingLLM :) Doc about the feature: https://docs.mistral.ai/capabilities/vision/#passing-a-base64-encoded-image
yindo added the enhancementfeature request labels 2026-02-22 18:25:16 -05:00
yindo closed this issue 2026-02-22 18:25:16 -05:00
yindo commented 2026-02-22 18:25:17 -05:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (Sep 21, 2024):

Are you using the "Mistral" LLM provider using that uses their hosted API service? I am presuming so

@timothycarambat commented on GitHub (Sep 21, 2024): Are you using the "Mistral" LLM provider using that uses their hosted API service? I am presuming so
yindo commented 2026-02-22 18:25:17 -05:00
Author
Owner
Copy Link
Copy Source

@nekopep commented on GitHub (Sep 22, 2024):

Yes, I'm using AnythingLLM as a "proxy" to diverse LLM provider (currently Mistral and ChatGPT)
Thanks for the merge ;)

@nekopep commented on GitHub (Sep 22, 2024): Yes, I'm using AnythingLLM as a "proxy" to diverse LLM provider (currently Mistral and ChatGPT) Thanks for the merge ;)
yindo commented 2026-02-22 18:25:17 -05:00
Author
Owner
Copy Link
Copy Source

@nekopep commented on GitHub (Sep 22, 2024):

Hi timothy works perfectly! Thks!

@nekopep commented on GitHub (Sep 22, 2024): Hi timothy works perfectly! Thks!
yindo changed title from [FEAT]: Add pixtral vision capabilities to [GH-ISSUE #2342] [FEAT]: Add pixtral vision capabilities 2026-06-05 14:41:14 -04:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Desktop
Docker
Integration Request
Integration Request
OS: Linux
OS: Mobile
OS: Windows
UI/UX
blocked
bug
bug
core-team-only
documentation
duplicate
embed-widget
enhancement
feature request
github_actions
good first issue
investigating
needs info / can't replicate
possible bug
pull-request
Mirrored from GitHub Pull Request
 question
stage: specifications
wontfix
No Label enhancement feature request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#1529
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?