cloudstack-llc/ollama
1
0
Fork 0
mirror of https://github.com/cloudstack-llc/ollama.git synced 2026-07-21 10:05:22 -04:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • 06093fd396 Merge pull request #4067 from dhiltgen/cudart Daniel Hiltgen 2024-05-06 13:30:27 -07:00
  • 86b7fcac32 Update README.md with StreamDeploy (#3621) Tony Loehr 2024-05-06 19:14:41 +01:00
  • fb8ddc564e chore: delete HEAD (#4194) Hyden Liu 2024-05-07 01:32:30 +08:00
  • 242efe6611 👌 IMPROVE: add portkey library for production tools (#4119) Saif 2024-05-06 22:55:23 +05:30
  • 1b0e6c9c0e Fix llava models not working after first request (#4164) Jeffrey Morgan 2024-05-05 20:50:31 -07:00
  • dfa2f32ca0 unload in critical section (#4187) Jeffrey Morgan 2024-05-05 17:18:27 -07:00
  • 840424a2c4 Merge pull request #4154 from dhiltgen/central_config Daniel Hiltgen 2024-05-05 17:08:26 -07:00
  • f56aa20014 Centralize server config handling Daniel Hiltgen 2024-05-04 11:46:01 -07:00
  • 6707768ebd chore: format go code (#4149) alwqx 2024-05-06 07:08:09 +08:00
  • c78bb76a12 update libraries for langchain_community + llama3 changed from llama2 (#4174) Lord Basil - Automate EVERYTHING 2024-05-05 19:07:04 -04:00
  • 942c979232 allocate a large enough kv cache for all parallel requests (#4162) Jeffrey Morgan 2024-05-05 15:59:32 -07:00
  • 06164911dd Update README.md (#4111) Bernardo de Oliveira Bruning 2024-05-05 18:45:32 -03:00
  • 2a21363bb7 validate the format of the digest when getting the model path (#4175) Patrick Devine 2024-05-05 11:46:12 -07:00
  • 026869915f Merge pull request #4144 from dhiltgen/max_queue Daniel Hiltgen 2024-05-05 10:53:44 -07:00
  • 45d61aaaa3 Add integration test to push max queue limits Daniel Hiltgen 2024-05-05 10:06:33 -07:00
  • 20f6c06569 Make maximum pending request configurable Daniel Hiltgen 2024-05-03 16:25:57 -07:00
  • 371f5e52aa Merge pull request #4141 from dhiltgen/win_docs Daniel Hiltgen 2024-05-04 12:50:16 -07:00
  • e006480e49 Explain the 2 different windows download options Daniel Hiltgen 2024-05-03 14:07:38 -07:00
  • aed545872d Merge pull request #4143 from ollama/mxyng/final-response Michael Yang 2024-05-03 17:39:49 -07:00
  • 44869c59d6 omit prompt and generate settings from final response Michael Yang 2024-05-03 16:11:49 -07:00
  • 52663284cf Merge pull request #4145 from dhiltgen/fix_lint Daniel Hiltgen 2024-05-03 16:53:17 -07:00
  • 42fa9d7f0a Fix lint warnings Daniel Hiltgen 2024-05-03 16:44:19 -07:00
  • b7a87a22b6 Merge pull request #4059 from ollama/mxyng/parser-2 Michael Yang 2024-05-03 13:01:22 -07:00
  • e8aaea030e Update 'llama2' -> 'llama3' in most places (#4116) Dr Nic Williams 2024-05-04 05:25:04 +10:00
  • b1ad3a43cb Skip PhysX cudart library Daniel Hiltgen 2024-05-03 11:55:32 -07:00
  • 267e25a750 Merge pull request #4129 from dhiltgen/unit_tests Daniel Hiltgen 2024-05-03 11:10:26 -07:00
  • 9a32c514cb Soften timeouts on sched unit tests Daniel Hiltgen 2024-05-03 09:08:33 -07:00
  • e9ae607ece Merge pull request #3892 from ollama/mxyng/parser Michael Yang 2024-05-02 17:04:47 -07:00
  • 93707fa3f2 Merge pull request #4108 from ollama/mxyng/lf Michael Yang 2024-05-02 14:55:15 -07:00
  • 94c369095f fix line ending Michael Yang 2024-05-02 14:52:21 -07:00
  • 9164b0161b Update .gitattributes v0.1.33 Jeffrey Morgan 2024-05-02 14:06:31 -04:00
  • e592e8fccb Support Fedoras standard ROCm location Daniel Hiltgen 2024-05-01 15:47:12 -07:00
  • bf4fc25f7b Add a /clear command (#3947) Bryce Reitano 2024-05-01 15:44:36 -06:00
  • 5b806d8d24 Merge pull request #4089 from ollama/mxyng/target-invalid v0.1.33-rc7 Michael Yang 2024-05-01 12:46:35 -07:00
  • cb1e072643 Merge pull request #4087 from ollama/mxyng/fix-host-port Michael Yang 2024-05-01 12:42:07 -07:00
  • 45b6a12e45 server: target invalid Michael Yang 2024-05-01 12:39:05 -07:00
  • 68755f1f5e chore: fix typo in docs/development.md (#4073) alwqx 2024-05-02 03:39:11 +08:00
  • 997a455039 want filepath Michael Yang 2024-05-01 12:33:41 -07:00
  • 88775e1ff9 strip scheme from name Michael Yang 2024-05-01 12:25:29 -07:00
  • 8867e744ff types/model: fix name for hostport Michael Yang 2024-05-01 12:14:53 -07:00
  • 4fd064bea6 Merge pull request #4031 from MarkWard0110/fix/issue-3736 Daniel Hiltgen 2024-05-01 12:13:26 -07:00
  • 59fbceedcc use lf for line endings (#4085) Jeffrey Morgan 2024-05-01 15:02:45 -04:00
  • 321d57e1a0 Removing go routine calling .wait from load. Mark Ward 2024-05-01 18:49:28 +00:00
  • ba26c7aa00 it will always return an error due to Kill() discarding Wait() errors Mark Ward 2024-04-29 22:48:14 +00:00
  • 63c763685f log when the waiting for the process to stop to help debug when other tasks execute during this wait. expire timer clear the timer reference because it will not be reused. close will clean up expireTimer if calling code has not already done this. Mark Ward 2024-04-29 18:06:56 +00:00
  • 34a4a94f13 ignore debug bin files Mark Ward 2024-04-29 15:05:54 +00:00
  • f4a73d57a4 fix runner expire during active use. Clearing the expire timer as it is used. Allowing the finish to assign an expire timer so that the runner will expire after no use. Mark Ward 2024-04-28 16:43:40 +00:00
  • 948114e3e3 fix sched to wait for the runner to terminate to ensure following vram check will be more accurate Mark Ward 2024-04-28 16:41:38 +00:00
  • a3e60d9058 README.md: fix typos (#4007) Arpit Jain 2024-05-02 02:39:38 +09:00
  • 8acb233668 use strings.Builder Michael Yang 2024-05-01 10:01:09 -07:00
  • 119589fcb3 rename parser to model/file Michael Yang 2024-04-30 10:55:19 -07:00
  • 5ea844964e cmd: import regexp Michael Yang 2024-05-01 09:53:36 -07:00
  • bd8eed57fc fix parser name Michael Yang 2024-04-26 17:11:47 -07:00
  • 9cf0f2e973 use parser.Format instead of templating modelfile Michael Yang 2024-04-26 16:59:31 -07:00
  • 176ad3aa6e parser: add commands format Michael Yang 2024-04-24 18:49:14 -07:00
  • 4d08363580 comments Michael Yang 2024-04-26 15:13:27 -07:00
  • 8907bf51d2 fix multiline Michael Yang 2024-04-24 19:17:26 -07:00
  • abe614c705 tests Michael Yang 2024-04-24 16:12:56 -07:00
  • 238715037d linting Michael Yang 2024-04-24 16:08:51 -07:00
  • c0a00f68ae refactor modelfile parser Michael Yang 2024-04-22 15:37:14 -07:00
  • f0c454ab57 gpu: add 512MiB to darwin minimum, metal doesn't have partial offloading overhead (#4068) v0.1.33-rc6 Jeffrey Morgan 2024-05-01 11:46:03 -04:00
  • 089daaeabc Add CUDA Driver API for GPU discovery Daniel Hiltgen 2024-04-30 16:42:48 -07:00
  • b9f74ff3d6 types/model: reintroduce Digest (#4065) Blake Mizerany 2024-04-30 16:38:03 -07:00
  • fcf4d60eee llm: add back check for empty token cache jmorganca 2024-04-30 17:38:44 -04:00
  • e33d5c2dbc update llama.cpp commit to 952d03d jmorganca 2024-04-30 17:31:20 -04:00
  • 18d9a7e1f1 update llama.cpp submodule to f364eb6 (#4060) Jeffrey Morgan 2024-04-30 17:25:39 -04:00
  • 8488388cbd Update README.md Michael 2024-04-30 15:45:56 -04:00
  • 588901f449 types/model: reduce Name.Filepath allocs from 5 to 2 (#4039) Blake Mizerany 2024-04-30 11:09:19 -07:00
  • 0a7fdbe533 prompt to display and add local ollama keys to account (#3717) Bruce MacDonald 2024-04-30 11:02:08 -07:00
  • 5950c176ca Update langchainpy.md (#4037) Christian Frantzen 2024-04-30 05:19:06 +02:00
  • 23d23409a0 Update llama.cpp (#4036) Daniel Hiltgen 2024-04-29 20:18:48 -07:00
  • 9009bedf13 better checking for OLLAMA_HOST variable (#3661) Patrick Devine 2024-04-29 19:14:07 -04:00
  • d4ac57e240 Merge pull request #4035 from dhiltgen/fix_relative_paths Daniel Hiltgen 2024-04-29 16:08:06 -07:00
  • 7b59d1770f Fix relative path lookup Daniel Hiltgen 2024-04-29 16:00:08 -07:00
  • 95ead8ffba Restart server on failure when running Windows app (#3985) Jeffrey Morgan 2024-04-29 10:07:52 -04:00
  • 7aa08a77ca llm: dont cap context window limit to training context window (#3988) Jeffrey Morgan 2024-04-29 10:07:30 -04:00
  • 7e432cdfac types/model: remove old comment (#4020) Blake Mizerany 2024-04-28 20:52:26 -07:00
  • 586672f490 fix copying model to itself (#4019) Jeffrey Morgan 2024-04-28 23:47:49 -04:00
  • b03408de74 Merge pull request #3972 from hmartinez82/win_arm64 Daniel Hiltgen 2024-04-28 14:52:58 -07:00
  • 1e6a28bf5b Merge pull request #4009 from dhiltgen/cpu_concurrency Daniel Hiltgen 2024-04-28 14:20:27 -07:00
  • d6e3b64582 Fix concurrency for CPU mode Daniel Hiltgen 2024-04-28 13:40:31 -07:00
  • 114c932a8e types/model: allow _ as starter character in Name parts (#3991) Blake Mizerany 2024-04-27 21:24:52 -07:00
  • 7f7103de06 mac: update setup command to llama3 (#3986) Jeffrey Morgan 2024-04-27 22:52:10 -04:00
  • c631a9c726 types/model: relax name length constraint from 2 to 1 (#3984) Blake Mizerany 2024-04-27 17:58:41 -07:00
  • 8fd9e56804 types/structs: drop unused structs package (#3981) Blake Mizerany 2024-04-27 14:06:11 -07:00
  • 8a65717f55 Do not build AVX runners on ARM64 Hernan Martinez 2024-04-26 23:41:23 -06:00
  • 6d3152a98a Use architecture specific folders in installer script Hernan Martinez 2024-04-26 23:35:16 -06:00
  • b438d485f1 Use architecture specific folders in the generate script Hernan Martinez 2024-04-26 23:34:12 -06:00
  • 204349b17b Use architecture specific folders in the build script Hernan Martinez 2024-04-26 23:26:03 -06:00
  • 86e67fc4a9 Add import declaration for windows,arm64 to llm.go Hernan Martinez 2024-04-26 22:24:53 -06:00
  • 2bed62926e types/model: remove Digest (for now) (#3970) Blake Mizerany 2024-04-26 21:14:28 -07:00
  • aad8d128a0 also look at cwd as a root for windows runners (#3959) Jeffrey Morgan 2024-04-26 19:14:08 -04:00
  • ec1acbb867 Merge pull request #3968 from dhiltgen/win_generate v0.1.33-rc5 Daniel Hiltgen 2024-04-26 16:03:38 -07:00
  • e4859c4563 Fine grain control over windows generate steps Daniel Hiltgen 2024-04-26 15:36:34 -07:00
  • 8e30eb26bd Updates the setup command to use llama3. (#3962) Nataly Merezhuk 2024-04-26 18:41:01 -04:00
  • 0b5c589ca2 Merge pull request #3966 from dhiltgen/bump Daniel Hiltgen 2024-04-26 15:36:53 -07:00
  • 65fadddc85 Merge pull request #3964 from ollama/mxyng/weights Michael Yang 2024-04-26 15:23:33 -07:00
  • ed5fb088c4 Fix target in gen_windows.ps1 Daniel Hiltgen 2024-04-26 15:10:42 -07:00
  • f81f308118 fix gemma, command-r layer weights Michael Yang 2024-04-26 15:00:54 -07:00
  • b1390a7b37 types/model: export ParseNameBare and Merge (#3957) Blake Mizerany 2024-04-26 14:58:07 -07:00