cloudstack-llc/ollama
1
0
Fork 0
mirror of https://github.com/cloudstack-llc/ollama.git synced 2026-07-19 22:53:30 -04:00
Code Issues Packages Projects Releases Wiki Activity
3,318 Commits 1 Branch 154 Tags
9b53e39d8e4e45004500a05d04891cbed427f22a
Commit Graph

3 Commits

Author SHA1 Message Date
Jeffrey Morgan f8241bfba3 gpu: report system free memory instead of 0 (#5521) 2024-07-06 19:35:04 -04:00
Michael Yang 41a272de9f darwin: no partial offloading if required memory greater than system 2024-04-16 11:22:38 -07:00
peanut256 a189810df6 Determine max VRAM on macOS using recommendedMaxWorkingSetSize (#2354) 
* read iogpu.wired_limit_mb on macOS

Fix for https://github.com/ollama/ollama/issues/1826

* improved determination of available vram on macOS

read the recommended maximal vram on macOS via Metal API

* Removed macOS-specific logging

* Remove logging from gpu_darwin.go

* release Core Foundation object

fixes a possible memory leak
 2024-02-25 18:16:45 -05:00