Daniel Hiltgen 39928a42e8 Always dynamically load the llm server library ...

This switches darwin to dynamic loading, and refactors the code now that no
static linking of the library is used on any platform

2024-01-11 08:42:47 -08:00

..

cpu_common.go

Always dynamically load the llm server library

2024-01-11 08:42:47 -08:00

gpu_darwin.go

Always dynamically load the llm server library

2024-01-11 08:42:47 -08:00

gpu_info_cpu.c

calculate overhead based number of gpu devices (#1875)

2024-01-09 15:53:33 -05:00

gpu_info_cuda.c

Harden GPU mgmt library lookup

2024-01-10 15:06:41 -08:00

gpu_info_cuda.h

Harden GPU mgmt library lookup

2024-01-10 15:06:41 -08:00

gpu_info_rocm.c

Support multiple variants for a given llm lib type

2024-01-10 17:27:51 -08:00

gpu_info_rocm.h

Support multiple variants for a given llm lib type

2024-01-10 17:27:51 -08:00

gpu_info.h

calculate overhead based number of gpu devices (#1875)

2024-01-09 15:53:33 -05:00

gpu_test.go

Always dynamically load the llm server library

2024-01-11 08:42:47 -08:00

gpu.go

Build multiple CPU variants and pick the best

2024-01-11 08:42:47 -08:00

types.go

Support multiple variants for a given llm lib type

2024-01-10 17:27:51 -08:00