Could not extract json string from output error #25

Closed
opened 2026-02-16 00:16:38 -05:00 by yindo · 4 comments
Owner

Originally created by @bishwaTharu on GitHub (Mar 2, 2024).

error_llamaparse

I tried to use Ollama and got this issue while parsing the nodes.

Originally created by @bishwaTharu on GitHub (Mar 2, 2024). ![error_llamaparse](https://github.com/run-llama/llama_parse/assets/71912170/d499c5d0-9f8c-41ef-ad2c-e79dee68f8e1) I tried to use Ollama and got this issue while parsing the nodes.
yindo closed this issue 2026-02-16 00:16:38 -05:00
Author
Owner

@anoopshrma commented on GitHub (Mar 3, 2024):

Yeah open-source llm are very reliable when it comes to parsing structured output.

@anoopshrma commented on GitHub (Mar 3, 2024): Yeah open-source llm are very reliable when it comes to parsing structured output.
Author
Owner

@bishwaTharu commented on GitHub (Mar 3, 2024):

Is there any way to fix the error? Any help is appreciated. @anoopshrma

@bishwaTharu commented on GitHub (Mar 3, 2024): Is there any way to fix the error? Any help is appreciated. @anoopshrma
Author
Owner

@httplups commented on GitHub (Mar 12, 2024):

Same problem here

@httplups commented on GitHub (Mar 12, 2024): Same problem here
Author
Owner

@anoopshrma commented on GitHub (Mar 13, 2024):

Open-source model requires good prompting to do what is told. And to make it return output in structured format is even harder.

Llamaindex has done a compatibility testing on various factors for open-source llms in which pydantic output support is one of them.

You can take a look at the llms which works for structured formats and which not here: https://docs.llamaindex.ai/en/stable/module_guides/models/llms.html#open-source-llms

@anoopshrma commented on GitHub (Mar 13, 2024): Open-source model requires good prompting to do what is told. And to make it return output in structured format is even harder. Llamaindex has done a compatibility testing on various factors for open-source llms in which pydantic output support is one of them. You can take a look at the llms which works for structured formats and which not here: https://docs.llamaindex.ai/en/stable/module_guides/models/llms.html#open-source-llms
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: run-llama/llama_cloud_services#25