Inconsistent Record Extraction #565

Open
opened 2026-02-16 00:18:17 -05:00 by yindo · 1 comment
Owner

Originally created by @LadyLegacyK on GitHub (Nov 10, 2025).

Hello,
I have been testing the extraction node and there are serious inconsistencies with data results.
Using the same pdf document with a table with headers and columns, a total record of 86 [as counted].

1st Run - Using Llama UI - The pdf document with 86 counted records, only extracted 76 [Document extraction]
2nd Run - Using Llama UI - The same pdf document with 86 records, only extracted 10 items [Document extraction]
3rd Run - Using LLama UI- The same pdf document with 86 records, only extracted 43 items [Page extraction]

Other than changing from 'Document' to 'Page' extraction, there is no reasonable explanation that I can conclude for the discrepancies.

If anyone can assists with explaining how to get consistent extraction results or help me with settings that would make the outcome of my extraction consistent and reliable.

Originally created by @LadyLegacyK on GitHub (Nov 10, 2025). Hello, I have been testing the extraction node and there are serious inconsistencies with data results. Using the same pdf document with a table with headers and columns, a total record of 86 [as counted]. 1st Run - Using Llama UI - The pdf document with 86 counted records, only extracted 76 [Document extraction] 2nd Run - Using Llama UI - The same pdf document with 86 records, only extracted 10 items [Document extraction] 3rd Run - Using LLama UI- The same pdf document with 86 records, only extracted 43 items [Page extraction] Other than changing from 'Document' to 'Page' extraction, there is no reasonable explanation that I can conclude for the discrepancies. If anyone can assists with explaining how to get consistent extraction results or help me with settings that would make the outcome of my extraction consistent and reliable.
Author
Owner

@neerajprad commented on GitHub (Nov 10, 2025):

@LadyLegacyK: Exhaustive extraction of table rows is hard for LLMs. We have a new experimental extraction target called "Table Row". Could you try that on Premium mode and let us know how it does? If it doesn't yield good results, please share your job_id. Note that you might have to modify your schema so that it corresponds to a single row in the table and you'll get results of type list[schema]

@neerajprad commented on GitHub (Nov 10, 2025): @LadyLegacyK: Exhaustive extraction of table rows is hard for LLMs. We have a new experimental extraction target called "Table Row". Could you try that on Premium mode and let us know how it does? If it doesn't yield good results, please share your job_id. Note that you might have to modify your schema so that it corresponds to a single row in the table and you'll get results of type `list[schema]`
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: run-llama/llama_cloud_services#565