Prompts Not Applied via API When Parsing #498

Closed
opened 2026-02-16 00:18:01 -05:00 by yindo · 4 comments
Owner

Originally created by @SaiCharan878 on GitHub (Jul 1, 2025).

Describe the bug
I'm not getting the expected response when using the Prompts feature (user_prompt, system_prompt, and system_prompt_append) via the API.
For example, when I use the GUI to parse an image and ask it to translate the content into French or Spanish, it works as expected.
However, when I make the same request using the API with similar prompts, it doesn't translate the content as instructed.

Files

Doc1.pdf

Job ID
287ce611-9ed8-4749-8573-639f6a371e45

Client:
Please remove untested options:

  • API

Additional context

llama = LlamaParse(
    api_key=llama_api_key,
    result_type="text",     
    verbose=True,
    num_workers=4,
    user_prompt=("If output is not in spanish, translate it in spanish."),
    use_vendor_multimodal_model=True,
    vendor_multimodal_model_name="openai-gpt-4-1"
)
Originally created by @SaiCharan878 on GitHub (Jul 1, 2025). **Describe the bug** I'm not getting the expected response when using the Prompts feature (user_prompt, system_prompt, and system_prompt_append) via the API. For example, when I use the GUI to parse an image and ask it to translate the content into French or Spanish, it works as expected. However, when I make the same request using the API with similar prompts, it doesn't translate the content as instructed. **Files** [Doc1.pdf](https://github.com/user-attachments/files/21006757/Doc1.pdf) **Job ID** 287ce611-9ed8-4749-8573-639f6a371e45 **Client:** Please remove untested options: - API **Additional context** ``` llama = LlamaParse( api_key=llama_api_key, result_type="text", verbose=True, num_workers=4, user_prompt=("If output is not in spanish, translate it in spanish."), use_vendor_multimodal_model=True, vendor_multimodal_model_name="openai-gpt-4-1" ) ```
yindo added the bug label 2026-02-16 00:18:01 -05:00
yindo closed this issue 2026-02-16 00:18:01 -05:00
Author
Owner

@logan-markewich commented on GitHub (Jul 1, 2025):

@SaiCharan878 What version of the SDK do you have? Have you tried updating?

The option is definitely passed to the API
https://github.com/run-llama/llama_cloud_services/blob/2fb7adfe0eff0f32278d619b54e1850a14047ef0/llama_cloud_services/parse/base.py#L961

I cannot reproduce either with your document
https://colab.research.google.com/drive/12XrJWP36qXC1vUqWSvi7-03xVhYLjRQa?usp=sharing

@logan-markewich commented on GitHub (Jul 1, 2025): @SaiCharan878 What version of the SDK do you have? Have you tried updating? The option is definitely passed to the API https://github.com/run-llama/llama_cloud_services/blob/2fb7adfe0eff0f32278d619b54e1850a14047ef0/llama_cloud_services/parse/base.py#L961 I cannot reproduce either with your document https://colab.research.google.com/drive/12XrJWP36qXC1vUqWSvi7-03xVhYLjRQa?usp=sharing
Author
Owner

@SaiCharan878 commented on GitHub (Jul 1, 2025):

@logan-markewich I am using llama-parse>=0.4.0

@SaiCharan878 commented on GitHub (Jul 1, 2025): @logan-markewich I am using llama-parse>=0.4.0
Author
Owner

@logan-markewich commented on GitHub (Jul 1, 2025):

@SaiCharan878 sure thats your requirement, but whats your actual installed version? pip show llama-cloud-services or pip show llama-parse ?

Note that llama-parse just re-exports the code from llama-cloud-services. Please see my notebook, try the code yourself, and see if it works

@logan-markewich commented on GitHub (Jul 1, 2025): @SaiCharan878 sure thats your requirement, but whats your actual installed version? `pip show llama-cloud-services` or `pip show llama-parse` ? Note that llama-parse just re-exports the code from llama-cloud-services. Please see my notebook, try the code yourself, and see if it works
Author
Owner

@SaiCharan878 commented on GitHub (Jul 1, 2025):

@logan-markewich Thanks for the quick follow-up!

I had previously set llama-parse>=0.4.0, but after your suggestion, I changed the dependency to llama-cloud-services and imported LlamaParse directly from it. That resolved the issue it's now working as expected with the prompt.

Appreciate your help!

@SaiCharan878 commented on GitHub (Jul 1, 2025): @logan-markewich Thanks for the quick follow-up! I had previously set llama-parse>=0.4.0, but after your suggestion, I changed the dependency to llama-cloud-services and imported LlamaParse directly from it. That resolved the issue it's now working as expected with the prompt. Appreciate your help!
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: run-llama/llama_cloud_services#498