Academic Papers #59

Open
opened 2026-02-16 00:16:45 -05:00 by yindo · 1 comment
Owner

Originally created by @relsas on GitHub (Mar 20, 2024).

I've now spent quite some time on testing to parse academic papers, with mediocre success only. In particular, the following issues occur:

  • A new page in the pdf always breaks the current paragraph, such that often sentences are interrupted and continued in the next paragraph.
  • If the pdf has footer or header information, this is repeated over an over, sometimes even classified as headers. Such footer info is then put between the body text when the page switch occurs, so that one cannot reconstruct interrupted sentences/paragraphs (see above)
  • Footnotes are not systematically recognized, numeration is in most cases lost, and sometimes footnotes appear in the body text
  • Formulas are barely translated to Latex.

Changing LLM instructions hasn’t helped.

Originally created by @relsas on GitHub (Mar 20, 2024). I've now spent quite some time on testing to parse academic papers, with mediocre success only. In particular, the following issues occur: - A new page in the pdf always breaks the current paragraph, such that often sentences are interrupted and continued in the next paragraph. - If the pdf has footer or header information, this is repeated over an over, sometimes even classified as headers. Such footer info is then put between the body text when the page switch occurs, so that one cannot reconstruct interrupted sentences/paragraphs (see above) - Footnotes are not systematically recognized, numeration is in most cases lost, and sometimes footnotes appear in the body text - Formulas are barely translated to Latex. Changing LLM instructions hasn’t helped.
Author
Owner

@dividor commented on GitHub (Aug 13, 2024):

Footnotes would be a huge improvement, right now they are not parsed

@dividor commented on GitHub (Aug 13, 2024): Footnotes would be a huge improvement, right now they are not parsed
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: run-llama/llama_cloud_services#59