cloudstack-llc/ollama
1
0
Fork 0
mirror of https://github.com/cloudstack-llc/ollama.git synced 2026-07-19 14:43:30 -04:00
Code Issues Packages Projects Releases Wiki Activity
1,234 Commits 1 Branch 154 Tags
bf6786bb398d81ed482e9cd3176fd629787edabc
Commit Graph

4 Commits

Author SHA1 Message Date
Michael Yang 058d0cd04b silence warm up log 2023-09-21 14:53:33 -07:00
Bruce MacDonald 09dd2aeff9 GGUF support (#441) 2023-09-07 13:55:37 -04:00
Jeffrey Morgan a82eb275ff update docs for subprocess 2023-08-30 17:54:02 -04:00
Bruce MacDonald 42998d797d subprocess llama.cpp server (#401) 
* remove c code
* pack llama.cpp
* use request context for llama_cpp
* let llama_cpp decide the number of threads to use
* stop llama runner when app stops
* remove sample count and duration metrics
* use go generate to get libraries
* tmp dir for running llm
 2023-08-30 16:35:03 -04:00