terribly slow: format="json", stream=False, please advise #40

Closed
opened 2026-02-15 16:27:39 -05:00 by yindo · 0 comments
Owner

Originally created by @eliranwong on GitHub (Feb 29, 2024).

I appreciate great work achieved with ollama. I see a lot of potential of use.

However, when I tested. I found that the generate and chat function takes way too long time to response, when I set format="json" and stream=False. Speed normal with non-json mode and stream. Please advise. many thanks.

Originally created by @eliranwong on GitHub (Feb 29, 2024). I appreciate great work achieved with ollama. I see a lot of potential of use. However, when I tested. I found that the generate and chat function takes way too long time to response, when I set format="json" and stream=False. Speed normal with non-json mode and stream. Please advise. many thanks.
yindo closed this issue 2026-02-15 16:27:39 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: ollama/ollama-python#40