Mintplex-Labs/anything-llm
1
0
Fork 0
mirror of https://github.com/Mintplex-Labs/anything-llm.git synced 2026-07-19 14:13:35 -04:00
Code Issues 328 Packages Projects Releases 10 Wiki Activity

[GH-ISSUE #2348] [FEAT]: Direct conversion of pdf into png for vision LLM #1531

New Issue
Closed
opened 2026-02-22 18:25:17 -05:00 by yindo · 2 comments
yindo commented 2026-02-22 18:25:17 -05:00
Owner
Copy Link
Copy Source

Originally created by @nekopep on GitHub (Sep 22, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2348

What would you like to see?

When I work with anything LLM each time I upload a doc it is automatically embedded by anythingLLM into the workspace.
From my experience I get low quality result working with direct embedding.
Thanks to your last commit to support MistralAi vision, I experimented using the same pdf and instead I did this:
#pdftoppm -png -r 100 airmontenegro.pdf > airmontenegro_100.png
#optipng -fix airmontenegro_100.png
and then I directly upload the image to the model and work with it.
I found it more accurate.

Would it be possible to work directly with pdf as image for vision LLM or add something in UI to allow this?

This is related to a more global issue I have with working with anythingLLM and pdf docs.
I think (and probbaly I'm compeltely wrong) that anythingLLM is thought as a chat interface able to ingest a ton of documents and work on this mass of data.
My use case is more basic, usually I want to work on only one pdf and in this case I found the workspace UI difficult to use to get the result I want.
Only today I get the result I wanted with this "pdf to image" trick.

This is a more general "last feature" missing to anythingLLM when users come from chatGPT and are used to make it ingest PDF.
AnythingLLM will gently absorb the pdf and add it to the workspace BUT add it to all other PDF currently in the workspace (generally not a thing basic users wants).
Even a /reset keep the docs, so if you work on different pdf iteration the workspace is messed up with all the pdf uploaded (because the /reset do not reset the file uploaded).

My feature request can be used for user to experiment pdf to image for vision LLM, allow basic user to work like in chatGPT and perhaps we could discuss in another ticket how to fix the more general usabilty issue I get with working with one shot pdf?

Example with pdf embedding:
image
Result:
image

Example with image conversion and direct upload:
image
(Much) Better result:
image

Thank you for any feedback

Originally created by @nekopep on GitHub (Sep 22, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2348 ### What would you like to see? When I work with anything LLM each time I upload a doc it is automatically embedded by anythingLLM into the workspace. From my experience I get low quality result working with direct embedding. Thanks to your last commit to support MistralAi vision, I experimented using the same pdf and instead I did this: #pdftoppm -png -r 100 airmontenegro.pdf > airmontenegro_100.png #optipng -fix airmontenegro_100.png and then I directly upload the image to the model and work with it. I found it more accurate. Would it be possible to work directly with pdf as image for vision LLM or add something in UI to allow this? This is related to a more global issue I have with working with anythingLLM and pdf docs. I think (and probbaly I'm compeltely wrong) that anythingLLM is thought as a chat interface able to ingest a ton of documents and work on this mass of data. My use case is more basic, usually I want to work on only one pdf and in this case I found the workspace UI difficult to use to get the result I want. Only today I get the result I wanted with this "pdf to image" trick. This is a more general "last feature" missing to anythingLLM when users come from chatGPT and are used to make it ingest PDF. AnythingLLM will gently absorb the pdf and add it to the workspace BUT add it to all other PDF currently in the workspace (generally not a thing basic users wants). Even a /reset keep the docs, so if you work on different pdf iteration the workspace is messed up with all the pdf uploaded (because the /reset do not reset the file uploaded). My feature request can be used for user to experiment pdf to image for vision LLM, allow basic user to work like in chatGPT and perhaps we could discuss in another ticket how to fix the more general usabilty issue I get with working with one shot pdf? Example with pdf embedding: ![image](https://github.com/user-attachments/assets/0366d822-f7e9-4f3d-ab03-9618ee9a705b) Result: ![image](https://github.com/user-attachments/assets/beec505c-4e19-4b20-9759-773e2618a902) Example with image conversion and direct upload: ![image](https://github.com/user-attachments/assets/fd6f3fed-ef17-4715-b5ff-f8c08993b0c3) (Much) Better result: ![image](https://github.com/user-attachments/assets/b95eb1d1-d20e-4089-be22-53991aecd009) Thank you for any feedback
yindo added the enhancementfeature request labels 2026-02-22 18:25:17 -05:00
yindo closed this issue 2026-02-22 18:25:17 -05:00
yindo commented 2026-02-22 18:25:18 -05:00
Author
Owner
Copy Link
Copy Source

@nekopep commented on GitHub (Sep 22, 2024):

Well, reviewing the pdf, perhaps my pdf was not the more suitable for the comparison, the vision LLM has a net advantage since it can analyze the data position to better understand the pdf.

Still, It make this feature request even more interesting ;)

@nekopep commented on GitHub (Sep 22, 2024): Well, reviewing the pdf, perhaps my pdf was not the more suitable for the comparison, the vision LLM has a net advantage since it can analyze the data position to better understand the pdf. Still, It make this feature request even more interesting ;)
yindo commented 2026-02-22 18:25:18 -05:00
Author
Owner
Copy Link
Copy Source

@nekopep commented on GitHub (Sep 22, 2024):

#2301 seems related to my feedback on anythingLLM usage for direct PDF analysis

@nekopep commented on GitHub (Sep 22, 2024): #2301 seems related to my feedback on anythingLLM usage for direct PDF analysis
yindo changed title from [FEAT]: Direct conversion of pdf into png for vision LLM to [GH-ISSUE #2348] [FEAT]: Direct conversion of pdf into png for vision LLM 2026-06-05 14:41:16 -04:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Desktop
Docker
Integration Request
Integration Request
OS: Linux
OS: Mobile
OS: Windows
UI/UX
blocked
bug
bug
core-team-only
documentation
duplicate
embed-widget
enhancement
feature request
github_actions
good first issue
investigating
needs info / can't replicate
possible bug
pull-request
Mirrored from GitHub Pull Request
 question
stage: specifications
wontfix
No Label enhancement feature request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#1531
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?