cloudstack-llc/ollama
1
0
Fork 0
mirror of https://github.com/cloudstack-llc/ollama.git synced 2026-07-20 07:04:02 -04:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • 123a722a6f zip: prevent extracting files into parent dirs (#5314) v0.1.47 Michael Yang 2024-06-26 21:38:21 -07:00
  • 4d311eb731 llm: architecture patch (#5316) Jeffrey Morgan 2024-06-26 21:38:12 -07:00
  • cb42e607c5 llm: speed up gguf decoding by a lot (#5246) v0.1.46 Blake Mizerany 2024-06-24 21:47:52 -07:00
  • 2aa91a937b cmd: defer stating model info until necessary (#5248) Blake Mizerany 2024-06-24 20:14:03 -07:00
  • ccef9431c8 Merge pull request #5205 from dhiltgen/modelfile_use_mmap Daniel Hiltgen 2024-06-21 16:30:36 -07:00
  • 642cee1342 Sort the ps output Daniel Hiltgen 2024-06-21 15:59:41 -07:00
  • 9a9e7d83c4 Docs (#5149) royjhan 2024-06-21 15:52:09 -07:00
  • 9929751cc8 Disable concurrency for AMD + Windows Daniel Hiltgen 2024-06-19 13:35:38 -07:00
  • 17b7186cd7 Enable concurrency by default Daniel Hiltgen 2024-05-06 17:47:52 -07:00
  • 189a43caa2 Merge pull request #5206 from ollama/mxyng/quantize Michael Yang 2024-06-21 13:44:34 -07:00
  • e835ef1836 fix: quantization with template Michael Yang 2024-06-21 13:30:43 -07:00
  • 7e7749224c Fix use_mmap parsing for modelfiles Daniel Hiltgen 2024-06-21 12:27:19 -07:00
  • c7c2f3bc22 Merge pull request #5194 from dhiltgen/linux_mmap_auto Daniel Hiltgen 2024-06-20 11:44:08 -07:00
  • 54a79d6a8a Merge pull request #5125 from dhiltgen/fedora39 Daniel Hiltgen 2024-06-20 11:27:24 -07:00
  • 5bf5aeec01 Refine mmap default logic on linux Daniel Hiltgen 2024-06-20 11:07:04 -07:00
  • e01e535cbb Merge pull request #5192 from ollama/mxyng/kv v0.1.45-rc5 v0.1.45 Michael Yang 2024-06-20 10:46:24 -07:00
  • 0195d6a2f8 Merge pull request #5188 from ollama/jyan/tmpdir2 Josh 2024-06-20 10:40:59 -07:00
  • 8e0641a9bf handle asymmetric embedding KVs Michael Yang 2024-06-20 09:40:17 -07:00
  • 662568d453 err!=nil check Josh Yan 2024-06-20 09:30:59 -07:00
  • 4ebb66c662 reformat error check Josh Yan 2024-06-20 09:23:43 -07:00
  • 23e899f32d skip os.removeAll() if PID does not exist Josh Yan 2024-06-20 08:51:35 -07:00
  • fedf71635e Extend api/show and ollama show to return more model info (#4881) v0.1.45-rc4 royjhan 2024-06-19 14:19:02 -07:00
  • 97c59be653 Merge pull request #5074 from dhiltgen/app_log_rotation Daniel Hiltgen 2024-06-19 13:02:24 -07:00
  • 9d8a4988e8 Implement log rotation for tray app Daniel Hiltgen 2024-06-15 16:30:37 -07:00
  • 1ae0750a21 Merge pull request #5147 from ollama/mxyng/cleanup Michael Yang 2024-06-19 12:50:31 -07:00
  • 9d91e5e587 remove confusing log message Michael Yang 2024-06-19 11:14:11 -07:00
  • 96624aa412 Merge pull request #5072 from dhiltgen/windows_path Daniel Hiltgen 2024-06-19 09:13:39 -07:00
  • 10f33b8537 Merge pull request #5146 from dhiltgen/backout Daniel Hiltgen 2024-06-19 09:12:45 -07:00
  • 4a633cc295 Merge pull request #5145 from dhiltgen/bad_loads Daniel Hiltgen 2024-06-19 09:12:33 -07:00
  • d34d88e417 Revert "Revert "gpu: add env var for detecting Intel oneapi gpus (#5076)"" Daniel Hiltgen 2024-06-19 08:57:41 -07:00
  • 52ce350b7a Fix bad symbol load detection Daniel Hiltgen 2024-06-19 08:39:07 -07:00
  • 2abebb2cbe Merge pull request #5128 from zhewang1-intc/fix_levelzero_empty_symbol_detect Daniel Hiltgen 2024-06-19 08:33:16 -07:00
  • 380e06e5be types/model: remove Digest Blake Mizerany 2024-06-18 13:29:38 -07:00
  • badf975e45 get real func ptr. Wang,Zhe 2024-06-19 09:00:51 +08:00
  • 755b4e4fc2 Revert "gpu: add env var for detecting Intel oneapi gpus (#5076)" Wang,Zhe 2024-06-19 08:59:58 +08:00
  • 1a1c99e334 Bump latest fedora cuda repo to 39 Daniel Hiltgen 2024-06-18 17:13:54 -07:00
  • 21adf8b6d2 Merge pull request #5121 from ollama/mxyng/deepseekv2 v0.1.45-rc3 Michael Yang 2024-06-18 16:30:58 -07:00
  • 784bf88b0d Wire up windows AMD driver reporting Daniel Hiltgen 2024-06-18 16:22:47 -07:00
  • e873841cbb deepseek v2 graph Michael Yang 2024-06-18 12:42:37 -07:00
  • 26d0bf9236 Merge pull request #5117 from dhiltgen/fix_prediction Daniel Hiltgen 2024-06-18 11:36:51 -07:00
  • 359b15a597 Handle models with divergent layer sizes Daniel Hiltgen 2024-06-18 11:05:34 -07:00
  • b55958a587 Merge pull request #5106 from dhiltgen/clean_logs Daniel Hiltgen 2024-06-18 09:24:38 -07:00
  • 7784ca33ce Tighten up memory prediction logging Daniel Hiltgen 2024-06-17 18:39:48 -07:00
  • c9c8c98bf6 Merge pull request #5105 from dhiltgen/cuda_mmap Daniel Hiltgen 2024-06-17 17:07:30 -07:00
  • 171796791f Adjust mmap logic for cuda windows for faster model load Daniel Hiltgen 2024-06-17 12:14:42 -07:00
  • 176d0f7075 Update import.md Jeffrey Morgan 2024-06-17 19:44:14 -04:00
  • 8ed51cac37 Merge pull request #5103 from dhiltgen/faster_win_build Daniel Hiltgen 2024-06-17 14:23:18 -07:00
  • c9e6f0542d Merge pull request #5069 from dhiltgen/ci_release Daniel Hiltgen 2024-06-17 13:59:37 -07:00
  • b0930626c5 Add back lower level parallel flags Daniel Hiltgen 2024-06-17 13:44:46 -07:00
  • e890be4814 Revert "More parallelism on windows generate" Daniel Hiltgen 2024-06-17 13:32:46 -07:00
  • b2799f111b Move libraries out of users path Daniel Hiltgen 2024-06-15 13:17:20 -07:00
  • 152fc202f5 llm: update llama.cpp commit to 7c26775 (#4896) v0.1.45-rc2 Jeffrey Morgan 2024-06-17 15:56:16 -04:00
  • 4ad0d4d6d3 Fix a build warning (#5096) Lei Jitang 2024-06-18 02:47:48 +08:00
  • 163cd3e77c gpu: add env var for detecting Intel oneapi gpus (#5076) Jeffrey Morgan 2024-06-16 20:09:05 -04:00
  • 4c2c8f93dd Merge pull request #5080 from dhiltgen/debug_intel_crash Daniel Hiltgen 2024-06-16 14:42:41 -07:00
  • fd1e6e0590 Add some more debugging logs for intel discovery Daniel Hiltgen 2024-06-16 07:42:52 -07:00
  • 89c79bec8c Add ModifiedAt Field to /api/show (#5033) royjhan 2024-06-15 20:53:56 -07:00
  • c7b77004e3 docs: add missing powershell package to windows development instructions (#5075) Jeffrey Morgan 2024-06-15 23:08:09 -04:00
  • 07d143f412 Merge pull request #5058 from coolljt0725/fix_build_warning Daniel Hiltgen 2024-06-15 11:52:36 -07:00
  • a12283e2ff Implement custom github release action Daniel Hiltgen 2024-06-15 08:26:54 -07:00
  • 4b0050cf0e Merge pull request #5037 from dhiltgen/faster_win_build v0.1.45-rc1 Daniel Hiltgen 2024-06-15 08:03:05 -07:00
  • 0577af98f4 More parallelism on windows generate Daniel Hiltgen 2024-06-13 17:13:01 -07:00
  • 17ce203a26 Merge pull request #4875 from dhiltgen/rocm_gfx900_workaround Daniel Hiltgen 2024-06-15 07:38:58 -07:00
  • d76555ffb5 Merge pull request #4874 from dhiltgen/rocm_v6_bump Daniel Hiltgen 2024-06-15 07:38:32 -07:00
  • 2786dff5d3 Merge pull request #4264 from dhiltgen/show_gpu_visible_settings Daniel Hiltgen 2024-06-15 07:33:52 -07:00
  • 225f0d1219 gpu: Fix build warning Lei Jitang 2024-06-15 14:26:23 +08:00
  • 532db58311 Merge pull request #4972 from jayson-cloude/main Daniel Hiltgen 2024-06-14 17:04:40 -07:00
  • 6be309e1bd Centralize GPU configuration vars Daniel Hiltgen 2024-05-08 11:11:50 -07:00
  • da3bf23354 Workaround gfx900 SDMA bugs Daniel Hiltgen 2024-05-31 16:15:21 -07:00
  • 26ab67732b Bump ROCm linux to 6.1.1 Daniel Hiltgen 2024-06-06 10:43:55 -07:00
  • 45cacbaf05 Merge pull request #4517 from dhiltgen/gpu_incremental Daniel Hiltgen 2024-06-14 15:35:00 -07:00
  • 17df6520c8 Remove mmap related output calc logic Daniel Hiltgen 2024-06-13 09:59:36 -07:00
  • 6f351bf586 review comments and coverage Daniel Hiltgen 2024-06-05 12:07:20 -07:00
  • ff4f0cbd1d Prevent multiple concurrent loads on the same gpus Daniel Hiltgen 2024-06-04 14:08:36 -07:00
  • fc37c192ae Refine CPU load behavior with system memory visibility Daniel Hiltgen 2024-06-03 19:09:23 -07:00
  • 434dfe30c5 Reintroduce nvidia nvml library for windows Daniel Hiltgen 2024-06-03 15:07:50 -07:00
  • 4e2b7e181d Refactor intel gpu discovery Daniel Hiltgen 2024-05-29 16:37:34 -07:00
  • 48702dd149 Harden unload for empty runners Daniel Hiltgen 2024-05-30 16:43:40 -07:00
  • 68dfc6236a refined test timing Daniel Hiltgen 2024-05-31 14:28:02 -07:00
  • 5e8ff556cb Support forced spreading for multi GPU Daniel Hiltgen 2024-05-08 14:32:42 -07:00
  • 6fd04ca922 Improve multi-gpu handling at the limit Daniel Hiltgen 2024-05-18 12:34:31 -07:00
  • 206797bda4 Fix concurrency integration test to work locally Daniel Hiltgen 2024-05-23 13:12:14 -07:00
  • 43ed358f9a Refine GPU discovery to bootstrap once Daniel Hiltgen 2024-05-15 15:13:16 -07:00
  • b32ebb4f29 Use DRM driver for VRAM info for amd Daniel Hiltgen 2024-05-14 16:18:42 -07:00
  • fb9cdfa723 Fix server.cpp for the new cuda build macros Daniel Hiltgen 2024-05-18 16:02:13 -07:00
  • efac488675 Revert "Limit GPU lib search for now (#4777)" Daniel Hiltgen 2024-06-03 08:31:48 -07:00
  • 6b800aa7b7 openai: do not set temperature to 0 when setting seed (#5045) Jeffrey Morgan 2024-06-14 13:43:56 -07:00
  • dd7c9ebeaf server: longer timeout in TestRequests (#5046) Jeffrey Morgan 2024-06-14 09:48:25 -07:00
  • 4dc7fb9525 update 40xx gpu compat matrix (#5036) Patrick Devine 2024-06-13 20:10:33 -04:00
  • c39761c552 Merge pull request #5032 from dhiltgen/actually_skip v0.1.44 Daniel Hiltgen 2024-06-13 13:26:09 -07:00
  • aac367636d Actually skip PhysX on windows Daniel Hiltgen 2024-06-13 13:17:19 -07:00
  • 15a687ae4b Merge pull request #5031 from ollama/mxyng/fix-multibyte-utf16 Michael Yang 2024-06-13 13:14:55 -07:00
  • d528e1af75 fix utf16 for multibyte runes Michael Yang 2024-06-13 11:39:01 -07:00
  • cd234ce22c parser: add test for multibyte runes Michael Yang 2024-06-13 11:09:22 -07:00
  • 94618b2365 add OLLAMA_MODELS to envconfig (#5029) Patrick Devine 2024-06-13 15:52:03 -04:00
  • 1fd236d177 server: remove jwt decoding error (#5027) Jeffrey Morgan 2024-06-13 11:21:15 -07:00
  • e87fc7200d Merge pull request #5025 from ollama/mxyng/revert-parser-scan Michael Yang 2024-06-13 10:31:25 -07:00
  • 20b9f8e6f4 Revert "proper utf16 support" Michael Yang 2024-06-13 10:22:16 -07:00
  • c69bc19e46 move OLLAMA_HOST to envconfig (#5009) Patrick Devine 2024-06-12 18:48:16 -04:00
  • bba5d177aa Merge pull request #5004 from ollama/mxyng/fix-templates Michael Yang 2024-06-12 14:39:29 -07:00