run-llama/llama_cloud_services
1
0
Fork 0
mirror of https://github.com/run-llama/llama_cloud_services.git synced 2026-07-19 16:43:32 -04:00
Code Issues 352 Packages Projects Releases 10 Wiki Activity

"I'm sorry, but I can't assist with that." markdown response when using is_formatting_instructions=True for PDFs #368

New Issue
Open
opened 2026-02-16 00:17:39 -05:00 by yindo · 1 comment
yindo commented 2026-02-16 00:17:39 -05:00
Owner
Copy Link
Copy Source

Originally created by @cholley6 on GitHub (Dec 6, 2024).

Describe the bug
Some PDF pages are returning "I'm sorry, but I can't assist with that" as the only response for markdown when using is_formatting instructions = True. We've seen this with multiple PDF files, and can't figure out the pattern that causes this. I believe this is an openAI error response of some sort.

I would also expect this to be considered a failure, whereas right now no error is returned.

We only see it in markdown results when using some input for formatting instructions.

Files
llama_bad_response.pdf
context from:
Noise Levels.pdf

Job ID
0aba7cc3-7ffd-4e68-bcd7-c1ba3f84eddd

Client:

  • Python Library
  • Frontend (cloud.llamaindex.ai)

Additional context
I first noticed the issue during the openAI outage on Dec, 4 2024: https://status.openai.com/

I've reproduced this in the Python Library as well as in the web UI.
Python sample code

LLAMA_PARSE_INSTRUCTIONS = (
    "This is a regulatory document. Do not remove, change, or add any language or text."
)
....
                parser = LlamaParse(
                    api_key=LLAMA_CLOUD_API_KEY,
                    result_type=ResultType.MD,
                    verbose=True,
                    show_progress=True,
                    parsing_instruction=LLAMA_PARSE_INSTRUCTIONS,
                    is_formatting_instruction=True,
                    ignore_errors=False,
                )

                docs = await parser.aload_data(pdf_path)
                text = "\n\n".join([doc.get_text() for doc in docs])
                return text

Note that ignore_errors=False here and there were no errors raised for this issue.

Originally created by @cholley6 on GitHub (Dec 6, 2024). **Describe the bug** Some PDF pages are returning "I'm sorry, but I can't assist with that" as the only response for markdown when using is_formatting instructions = True. We've seen this with multiple PDF files, and can't figure out the pattern that causes this. I believe this is an openAI error response of some sort. I would also expect this to be considered a failure, whereas right now no error is returned. We only see it in markdown results when using some input for formatting instructions. **Files** [llama_bad_response.pdf](https://github.com/user-attachments/files/18044275/llama_bad_response.pdf) context from: [Noise Levels.pdf](https://github.com/user-attachments/files/18044277/Noise.Levels.pdf) **Job ID** 0aba7cc3-7ffd-4e68-bcd7-c1ba3f84eddd **Client:** - Python Library - Frontend (cloud.llamaindex.ai) **Additional context** I first noticed the issue during the openAI outage on Dec, 4 2024: https://status.openai.com/ I've reproduced this in the Python Library as well as in the web UI. Python sample code ```python LLAMA_PARSE_INSTRUCTIONS = ( "This is a regulatory document. Do not remove, change, or add any language or text." ) .... parser = LlamaParse( api_key=LLAMA_CLOUD_API_KEY, result_type=ResultType.MD, verbose=True, show_progress=True, parsing_instruction=LLAMA_PARSE_INSTRUCTIONS, is_formatting_instruction=True, ignore_errors=False, ) docs = await parser.aload_data(pdf_path) text = "\n\n".join([doc.get_text() for doc in docs]) return text ``` Note that `ignore_errors=False` here and there were no errors raised for this issue.
yindo added the bug label 2026-02-16 00:17:39 -05:00
yindo commented 2026-02-16 00:17:39 -05:00
Author
Owner
Copy Link
Copy Source

@cholley6 commented on GitHub (Dec 9, 2024):

I can't find a workaround for this using the python library. In the UI, if the formatting instructions are false, there's no issue. But in the python lib, even when is_formatting_instructions are False, the issue persists.

@cholley6 commented on GitHub (Dec 9, 2024): I can't find a workaround for this using the python library. In the UI, if the formatting instructions are false, there's no issue. But in the python lib, even when is_formatting_instructions are False, the issue persists.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
LlamaCloud
LlamaExtract
LlamaParse
bug
client
complex layout
documentation
duplicate
enhancement
figure
font
header footer
help wanted
ocr
parser
pdf_debug
pdf_debug
pull-request
Mirrored from GitHub Pull Request
 python-lib
question
server_issue
server_issue
ui
No Label bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: run-llama/llama_cloud_services#368
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?