Daniel Hiltgen 7427fa1387 Fix up the CPU fallback selection ...

The memory changes and multi-variant change had some merge
glitches I missed.  This fixes them so we actually get the cpu llm lib
and best variant for the given system.

2024-01-11 15:27:06 -08:00

..

cpu_common.go

Always dynamically load the llm server library

2024-01-11 08:42:47 -08:00

gpu_darwin.go

Fix up the CPU fallback selection

2024-01-11 15:27:06 -08:00

gpu_info_cpu.c

calculate overhead based number of gpu devices (#1875)

2024-01-09 15:53:33 -05:00

gpu_info_cuda.c

Harden GPU mgmt library lookup

2024-01-10 15:06:41 -08:00

gpu_info_cuda.h

Harden GPU mgmt library lookup

2024-01-10 15:06:41 -08:00

gpu_info_rocm.c

Support multiple variants for a given llm lib type

2024-01-10 17:27:51 -08:00

gpu_info_rocm.h

Support multiple variants for a given llm lib type

2024-01-10 17:27:51 -08:00

gpu_info.h

calculate overhead based number of gpu devices (#1875)

2024-01-09 15:53:33 -05:00

gpu_test.go

Merge pull request #1819 from dhiltgen/multi_variant

2024-01-11 14:00:48 -08:00

gpu.go

Build multiple CPU variants and pick the best

2024-01-11 08:42:47 -08:00

types.go

Support multiple variants for a given llm lib type

2024-01-10 17:27:51 -08:00