GPU- Utilization freezing #78

Open
opened 2026-02-15 16:27:53 -05:00 by yindo · 0 comments
Owner

Originally created by @ankitvirla on GitHub (May 2, 2024).

sometime, GPU- Util memory is freezing, when I'm using mistral through ollama-python . Creating a host using "Client" method.

image

sometime GPU util reaching to 93%, and everything hanging.

image

is there anyone who faced the same issue, any solution for the same.

Thanks.

Originally created by @ankitvirla on GitHub (May 2, 2024). sometime, GPU- Util memory is freezing, when I'm using mistral through ollama-python . Creating a host using "Client" method. ![image](https://github.com/ollama/ollama-python/assets/39473129/a1bdb8ce-a72b-45f4-b87c-17d3cd18c941) sometime GPU util reaching to 93%, and everything hanging. ![image](https://github.com/ollama/ollama-python/assets/39473129/83d0dcd0-c57d-43c7-bcf7-9be276e02071) is there anyone who faced the same issue, any solution for the same. Thanks.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: ollama/ollama-python#78