mirror of
https://github.com/ollama/ollama-python.git
synced 2026-07-21 00:55:21 -04:00
OLLAMA Python, Why can't I use all the threads on the CPU? #89
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @HamzaYslmn on GitHub (May 23, 2024).
I analyzed the problem in depth. I get faster responses when I use the terminal, something is wrong with Python. Just use E-cores and its too slow.
I HAVE:
i9 - 13980HX
24 Core - 32 Thread
@HamzaYslmn commented on GitHub (May 24, 2024):
When I test with the GPU, there is a 30% speed difference between running from Python and running from Terminal. Why is this problem happening?