3rd Party multi-modal model gemini-2.0-flash-001 responds with MANY '-' and whitespaces in tables causing >1000 chunks for 1 page #428

Open
opened 2026-02-16 00:17:48 -05:00 by yindo · 2 comments
Owner

Originally created by @JohanBekker on GitHub (Feb 11, 2025).

Describe the bug
3rd Party multi-modal model gemini-2.0-flash-001 sometimes uses a lot of -'s to describe a markdown table, exploding the number of tokens for the page. With a chunk size of <=512, this sometimes leads to >1000 chunks for a single page.

Files
https://www.asml.com/en/investors/annual-report/2023

Job ID
0d446037-f53b-4cd0-8978-dfd346e50915

Client:
Please remove untested options:

  • Python Library
  • API

Additional context
Response for page 347 of the ASML annual report is added as file because it didn't fit in here.

page_347.json

Originally created by @JohanBekker on GitHub (Feb 11, 2025). **Describe the bug** 3rd Party multi-modal model gemini-2.0-flash-001 sometimes uses a lot of `-`'s to describe a markdown table, exploding the number of tokens for the page. With a chunk size of <=512, this sometimes leads to >1000 chunks for a single page. **Files** https://www.asml.com/en/investors/annual-report/2023 **Job ID** 0d446037-f53b-4cd0-8978-dfd346e50915 **Client:** Please remove untested options: - Python Library - API **Additional context** Response for page 347 of the ASML annual report is added as file because it didn't fit in here. [page_347.json](https://github.com/user-attachments/files/18751633/page_347.json)
yindo added the bug label 2026-02-16 00:17:48 -05:00
Author
Owner

@JohanBekker commented on GitHub (Mar 7, 2025):

Could I get a response to this? It has been >3 weeks, gemini flash 2.0 mode is completely unusable because of this.

https://www.asml.com/en/investors/annual-report/2023
192b4682-e427-4e95-8769-173c0789aefb
ab7723d8-e381-4334-9660-7a12dacc8cc3
fb3bd4e3-f27e-49cf-8539-d58fe7eac570

@JohanBekker commented on GitHub (Mar 7, 2025): Could I get a response to this? It has been >3 weeks, gemini flash 2.0 mode is completely unusable because of this. https://www.asml.com/en/investors/annual-report/2023 192b4682-e427-4e95-8769-173c0789aefb ab7723d8-e381-4334-9660-7a12dacc8cc3 fb3bd4e3-f27e-49cf-8539-d58fe7eac570
Author
Owner

@TLTP1995 commented on GitHub (Jul 6, 2025):

same issue. It either posts
, /n or "-"

@TLTP1995 commented on GitHub (Jul 6, 2025): same issue. It either posts <br>, /n or "-"
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: run-llama/llama_cloud_services#428