ollama/ollama-python
1
0
Fork 0
mirror of https://github.com/ollama/ollama-python.git synced 2026-07-21 09:05:23 -04:00
Code Issues 101 Packages Projects Releases 10 Wiki Activity

Error message is not helpful when the input to a model exceeds the limit. #176

New Issue
Open
opened 2026-02-15 16:28:30 -05:00 by yindo · 1 comment
yindo commented 2026-02-15 16:28:30 -05:00
Owner
Copy Link
Copy Source

Originally created by @gamer-mitsuha on GitHub (Dec 1, 2024).

Originally assigned to: @ParthSareen on GitHub.

Context: I tried to send chunked texts to an embedding model using Ollama and got the following error:

.venv/lib/python3.12/site-packages/ollama/_client.py", line 120, in _request_raw
    raise ResponseError(e.response.text, e.response.status_code) from None
ollama._types.ResponseError: {}

It was not clear what happened and I had to check the failed batch of examples and examine what happened. Eventually I was able to figure out the reason is that the chunk limit is higher than the allowed input size, and thus the server returns error for such long inputs.

I'm wondering if it's possible to produce more helpful error message in such cases?

Originally created by @gamer-mitsuha on GitHub (Dec 1, 2024). Originally assigned to: @ParthSareen on GitHub. Context: I tried to send chunked texts to an embedding model using Ollama and got the following error: ``` .venv/lib/python3.12/site-packages/ollama/_client.py", line 120, in _request_raw raise ResponseError(e.response.text, e.response.status_code) from None ollama._types.ResponseError: {} ``` It was not clear what happened and I had to check the failed batch of examples and examine what happened. Eventually I was able to figure out the reason is that the chunk limit is higher than the allowed input size, and thus the server returns error for such long inputs. I'm wondering if it's possible to produce more helpful error message in such cases?
yindo commented 2026-02-15 16:28:30 -05:00
Author
Owner
Copy Link
Copy Source

@ParthSareen commented on GitHub (Dec 1, 2024):

Hey @gamer-mitsuha - sorry about that. Seems like the Ollama server didn't give an output back or we should have captured that. Thanks for raising - will take a look!

@ParthSareen commented on GitHub (Dec 1, 2024): Hey @gamer-mitsuha - sorry about that. Seems like the Ollama server didn't give an output back or we should have captured that. Thanks for raising - will take a look!
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
enhancement
pull-request
Mirrored from GitHub Pull Request
 thinking
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: ollama/ollama-python#176
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?