client run timeout,no response #45

Open
opened 2026-02-15 16:27:41 -05:00 by yindo · 3 comments
Owner

Originally created by @songsh on GitHub (Mar 6, 2024).

response = ollama.Client(host = 'http://xxxxx').generate(model='gemma',prompt=prompt,format='json',options={"seed": 101,"temperature": 0},keep_alive=7)
run timeout, no resonse.

Originally created by @songsh on GitHub (Mar 6, 2024). response = ollama.Client(host = 'http://xxxxx').generate(model='gemma',prompt=prompt,format='json',options={"seed": 101,"temperature": 0},keep_alive=7) run timeout, no resonse.
Author
Owner

@songsh commented on GitHub (Mar 6, 2024):

i found when token too much, then no response

@songsh commented on GitHub (Mar 6, 2024): i found when token too much, then no response
Author
Owner

@hahchenchen commented on GitHub (Mar 28, 2024):

meet the same problem, how to fix it?

@hahchenchen commented on GitHub (Mar 28, 2024): meet the same problem, how to fix it?
Author
Owner

@themw123 commented on GitHub (May 30, 2024):

same for me. When context gets to high by appending the history with every request, i get an empty response from time to time like in 30% of responses.

edit: oh i see you meant no response at all. I get one, but as i sayed empty one. I think it is a different issue. Also i am facing it only by using llama3 8b. But i see now i get the same problem by using plain ollama api, so it should not be related to ollama-python client

@themw123 commented on GitHub (May 30, 2024): same for me. When context gets to high by appending the history with every request, i get an empty response from time to time like in 30% of responses. edit: oh i see you meant no response at all. I get one, but as i sayed empty one. I think it is a different issue. Also i am facing it only by using llama3 8b. But i see now i get the same problem by using plain ollama api, so it should not be related to ollama-python client
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: ollama/ollama-python#45