mirror of
https://github.com/ollama/ollama-python.git
synced 2026-07-21 09:05:23 -04:00
client run timeout,no response #45
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @songsh on GitHub (Mar 6, 2024).
response = ollama.Client(host = 'http://xxxxx').generate(model='gemma',prompt=prompt,format='json',options={"seed": 101,"temperature": 0},keep_alive=7)
run timeout, no resonse.
@songsh commented on GitHub (Mar 6, 2024):
i found when token too much, then no response
@hahchenchen commented on GitHub (Mar 28, 2024):
meet the same problem, how to fix it?
@themw123 commented on GitHub (May 30, 2024):
same for me. When context gets to high by appending the history with every request, i get an empty response from time to time like in 30% of responses.
edit: oh i see you meant no response at all. I get one, but as i sayed empty one. I think it is a different issue. Also i am facing it only by using llama3 8b. But i see now i get the same problem by using plain ollama api, so it should not be related to ollama-python client