Commit Graph

  • ac283dbce7 ci : add building in MSYS2 environments (Windows) (#1994) Przemysław Pawełczyk 2024-03-30 08:20:20 +01:00
  • 1e8f28c42a build : use pkg-config for OpenBLAS (#1778) Przemysław Pawełczyk 2024-03-29 14:53:26 +01:00
  • fc366b807a main : add command-style grammar (#1998) ulatekh 2024-03-28 03:02:10 -07:00
  • 9fb308d90f make : add grammar parser to common objects Georgi Gerganov 2024-03-28 11:59:48 +02:00
  • 2948c740a2 sync : ggml (#2001) Georgi Gerganov 2024-03-27 18:55:10 +02:00
  • 1558ec5a16 whisper : improve handling of prompts (#1981) Georgi Gerganov 2024-03-25 14:48:19 +02:00
  • fff24a0148 whisper : improve support for distil-large-v3 (#1982) Sanchit Gandhi 2024-03-21 22:23:30 +05:30
  • 48a145207e ruby : fix build (#1980) Georgi Gerganov 2024-03-21 07:40:09 +02:00
  • 79d5765e7e docker : libcuda.so.1 in PATH (#1966) Tiago Fassoni 2024-03-20 13:45:15 -03:00
  • 04e48094e4 readme : add Fedora dependencies (#1970) Mohammadreza Hendiani 2024-03-20 20:12:11 +03:30
  • 741abb162c whisper : token-level timestamps with DTW (#1485) denersc 2024-03-20 13:25:26 -03:00
  • e7794a868f examples : rename --audio-context to --audio-ctx per help text (#1953) Jo Liss 2024-03-18 15:53:33 +00:00
  • 725350d4ea whisper : set outputs from conv graph (#1959) Georgi Gerganov 2024-03-16 17:30:55 +02:00
  • 906c73b219 alloc : fix allocation data of pre-allocated leafs slaren 2024-03-16 15:47:14 +01:00
  • 00d80ff965 cmake : copy ggml-common.h to bin Georgi Gerganov 2024-03-16 17:15:21 +02:00
  • 1b553b9817 gitignore : .vimspector.json Georgi Gerganov 2024-03-16 16:26:35 +02:00
  • de4d067f1e talk-llama : sync llama.cpp Georgi Gerganov 2024-03-15 14:21:59 +02:00
  • e715f6a601 sync : ggml Georgi Gerganov 2024-03-15 14:12:19 +02:00
  • f60ccfd83b update examples and tests slaren 2024-03-14 16:45:27 +01:00
  • 3753a2b2a8 ggml : add ggml-common.h Georgi Gerganov 2024-03-14 17:16:45 +02:00
  • 592dd25615 ggml : designate enum vals for integer types (llama/6050) Georgi Gerganov 2024-03-14 12:38:37 +02:00
  • c8709d4604 metal : build metallib + fix embed path (llama/6015) Georgi Gerganov 2024-03-14 11:55:23 +02:00
  • 8932c2d6ce llama : add pipeline parallelism support (llama/6017) slaren 2024-03-13 18:54:21 +01:00
  • 2bddfdd7c8 Update get version (llama/6025) AidanBeltonS 2024-03-13 13:17:54 +00:00
  • 46e3c3f112 ggml : reuse quantum structs across backends (llama/5943) Georgi Gerganov 2024-03-12 14:27:20 +02:00
  • ef24ae0c7d ggml : fix UB in IQ2_S and IQ3_S (llama/6012) Georgi Gerganov 2024-03-12 13:49:55 +02:00
  • a753926f02 sycl : update IQ1_S kernels (WIP - not working!) (llama/5995) Georgi Gerganov 2024-03-12 11:15:05 +02:00
  • 9dc60fc02d 1.5 bit: we can do even better (llama/5999) Kawrakow 2024-03-11 16:53:15 +01:00
  • d73a63629e ggml, ci : Windows ARM runner and build fixes (llama/5979) Michael Podvitskiy 2024-03-11 10:28:51 +01:00
  • f79d0d4f74 Better 1.5 bit quantization (llama/5971) Kawrakow 2024-03-11 07:51:49 +01:00
  • 4f88940ff6 Add q3_s and q1_s (llama/5886) Abhilash Majumder 2024-03-11 10:27:56 +05:30
  • 7bdb1de9ec metal : move mm_id indices to shared mem (llama/5982) Georgi Gerganov 2024-03-10 23:12:48 +02:00
  • 653d2e8ff9 ggml : fix unnecessary f32 -> f16 -> f32 casts (mmla) (llama/5951) Georgi Gerganov 2024-03-09 17:36:20 +02:00
  • 2fef660d0a ggml : remove old quantization functions (llama/5942) Georgi Gerganov 2024-03-09 15:53:59 +02:00
  • 24eba5a2ff ggml : add ggml-common.h to deduplicate shared code (llama/5940) Georgi Gerganov 2024-03-09 12:47:57 +02:00
  • 6e9d3aa32d llama : support Mamba Selective State Space Models (llama/5328) compilade 2024-03-08 17:31:00 -05:00
  • 9ae0d18856 extra : update sync scripts after ggml-common.h Georgi Gerganov 2024-03-15 14:00:53 +02:00
  • a56f435fd4 whisper : document whisper_batch.n_seq_id (#1942) Josh Bleecher Snyder 2024-03-10 07:55:22 -07:00
  • ec166499d8 whisper : improve beam search candidate diversity (#1947) Josh Bleecher Snyder 2024-03-10 07:54:43 -07:00
  • ccf022f970 bindings/go : add linker flags to make metal work (#1944) Josh Bleecher Snyder 2024-03-09 08:50:44 -08:00
  • 2852e1af55 whisper : make beam candidate sort more stable (#1943) Josh Bleecher Snyder 2024-03-09 08:50:03 -08:00
  • ce945b50c3 ggml : try fix 32-bit arm compat (#1938) Georgi Gerganov 2024-03-08 23:45:07 +02:00
  • 2f5a5a66dd talk-llama : use llama_decode instead of llama_eval Georgi Gerganov 2024-03-08 12:04:43 +02:00
  • 8e409d1113 talk-llama : sync llama.cpp Georgi Gerganov 2024-03-08 11:55:50 +02:00
  • 05d1b61af4 talk-llama : sync llama.cpp Georgi Gerganov 2024-03-08 11:52:47 +02:00
  • 647cae178a sync : ggml Georgi Gerganov 2024-03-08 11:39:34 +02:00
  • bae7c23fbf Revert "[SYCL] fix error when set main gpu to non-zero (llama/5901)" (llama/5918) Neo Zhang Jianyu 2024-03-07 19:14:49 +08:00
  • 18ea187d42 fix error when set main gpu to non-zero (llama/5901) Neo Zhang Jianyu 2024-03-07 16:34:31 +08:00
  • 1daeffca54 ggml : use SYS_get_cpu if SYS_getcpu is not defined (llama/5906) Jared Van Bortel 2024-03-06 15:42:23 -05:00
  • 2f6f1d4465 ggml : use uint8x16_t return type for ggml_vqtbl1q_u8 (llama/5894) bobqianic 2024-03-06 07:35:07 +00:00
  • 7ff1894c34 add wait() to make code stable (llama/5895) Neo Zhang Jianyu 2024-03-06 12:08:32 +08:00
  • 8edfc54c2b quants : use MM256_SET_M128I consistently to fix gcc 7 build (llama/5889) Jared Van Bortel 2024-03-05 11:56:37 -05:00
  • 9c399689ec Vulkan Improvements (llama/5835) 0cc4m 2024-03-05 13:33:42 +01:00
  • 9d9a405cfd fix mul_mat fault in CI/unit-test (llama/5862) Neo Zhang Jianyu 2024-03-05 16:08:35 +08:00
  • edd8b38a75 ggml : fix unknown status (llama/0) Georgi Gerganov 2024-03-04 20:53:27 +02:00
  • ed76818700 whisper : fix compute helper return (ggml/750) Georgi Gerganov 2024-03-05 16:05:23 +02:00
  • 9a0b59d990 ggml : introduce ggml_status (ggml/750) Michael Podvitskiy 2024-03-04 10:05:42 +01:00
  • 93a84a143b cuda : fix data race in soft max (llama/5853) slaren 2024-03-03 14:26:18 +01:00
  • bd26876267 ggml : fix IQ3_S AVX implementation (llama/5834) Georgi Gerganov 2024-03-02 20:00:49 +02:00
  • 21d295180d ggml : IQ3_S improvements (llama/5829) Kawrakow 2024-03-02 17:00:51 +02:00
  • c3bfc9bfda Support multiple GPUs (split mode) on SYCL backend (llama/5806) Neo Zhang Jianyu 2024-03-02 19:49:30 +08:00
  • 422a6b16fc ggml-vulkan: fix VULKAN_CHECK_RESULTS flag, which was previously broken (llama/5813) ddpasa 2024-03-01 18:00:00 +01:00
  • 11dd0d4482 Use batched mul_mat pathway (llama/5591) AidanBeltonS 2024-03-01 07:36:47 +00:00
  • 26dd2f06ac make portability_enumeration_ext apple only (llama/5757) Eve 2024-02-28 19:33:37 +00:00
  • 8cee7c08b6 add some new ops, fix some operators and add batch operations to certain operators. (ggml/747) leejet 2024-03-03 20:23:52 +08:00
  • 2e2626b167 examples : Auto lowercase language parameter in main.cpp (#1928) F1L1P 2024-03-06 23:25:10 +01:00
  • c0c0ae2dea examples : fix typo in bench.cpp (#1933) zhouwg 2024-03-07 06:21:44 +08:00
  • 897412b5b6 whisper : fix typo (#1925) zhouwg 2024-03-05 23:06:31 +08:00
  • f22d27a385 whisper.android.java : fix returns in JNI (#1929) zhouwg 2024-03-05 21:59:26 +08:00
  • ccd7c1d2da cmake : add library versioning (#1352) kennethge 2024-03-04 14:17:48 -05:00
  • c713eb5e2a readme : recommend MacOS Sonoma for Core ML (#1917) Gavin Cai 2024-03-04 11:16:13 -08:00
  • 25d313b38b talk-llama : sync llama.cpp Georgi Gerganov 2024-02-28 13:04:05 +02:00
  • 3168dbf23b sync : ggml Georgi Gerganov 2024-02-28 13:01:33 +02:00
  • 1711bb3881 sync : llama.cpp (ggml/0) Georgi Gerganov 2024-02-28 12:59:11 +02:00
  • 2533305596 ggml : make i-quants work with super-blocks of 64 (CPU,Metal) (llama/5760) Kawrakow 2024-02-28 10:37:02 +02:00
  • 0eca512ac8 Attempt to fix android build (llama/5752) Kawrakow 2024-02-27 19:16:49 +02:00
  • 013e394a4b IQ4_XS: a 4.25 bpw quantization (llama/5747) Kawrakow 2024-02-27 16:34:24 +02:00
  • d83f371b5f cuda : replace remaining shfl_xor with calls to warp_reduce functions (llama/5744) Engininja2 2024-02-27 07:22:45 -06:00
  • 1c71816eab ggml-quants : fix avx2 iq1_s vec_dot when compiled with gcc (llama/5742) Engininja2 2024-02-27 06:50:18 -06:00
  • 7b1d8ea7e0 Adding IQ2_S and IQ2_M to complete coverage of the 2-3 bit quantization range (llama/5721) Kawrakow 2024-02-26 18:28:38 +02:00
  • b1f7223a0a CUDA: fix DEBUG_CUDA_MALLOC (llama/5729) Johannes Gäßler 2024-02-26 15:36:38 +01:00
  • 8408a4be8e Add support for soft_max ALiBi (llama/5639) AidanBeltonS 2024-02-26 14:02:11 +00:00
  • 72849c24ba ggml-quants : provide ggml_vqtbl1q_u8 for 64bit compatibility (llama/5711) Radosław Gryta 2024-02-25 19:43:00 +01:00
  • c19c28be71 add google magika inference example (ggml/748) slaren 2024-02-25 20:41:35 +01:00
  • 0d8fd8483a stream.wasm : fix invalid memory access when no segments (#1902) Andrew S 2024-02-26 02:12:35 -06:00
  • 3170841ed9 talk-llama : sync llama.cpp Georgi Gerganov 2024-02-25 20:00:10 +02:00
  • 7a6e385c1b sync : ggml Georgi Gerganov 2024-02-25 19:59:34 +02:00
  • 578e47e70c sync : llama.cpp (ggml/0) Georgi Gerganov 2024-02-25 19:58:06 +02:00
  • fac5b43830 code : normalize enum names (llama/5697) Georgi Gerganov 2024-02-25 12:09:09 +02:00
  • 9e7c5212a1 IQ3_S: a much better alternative to Q3_K (llama/5676) Kawrakow 2024-02-24 16:23:52 +02:00
  • 1cb64f7368 Introduce backend GUIDs (ggml/743) UEXTM.com 2024-02-24 11:27:36 -05:00
  • f18738f247 talk, talk-llama : pass text_to_speak as a file (#1865) Tamotsu Takahashi 2024-02-24 16:24:47 +09:00
  • a0ddd8392c whisper : add SYCL support (#1863) Abhilash Majumder 2024-02-23 12:52:24 +05:30
  • a2506909b1 talk-llama : sync llama.cpp Georgi Gerganov 2024-02-22 23:30:53 +02:00
  • 7b1ff212d9 sync : ggml Georgi Gerganov 2024-02-22 23:25:38 +02:00
  • e5d06cfc0f ggml : always define ggml_fp16_t as uint16_t (llama/5666) Georgi Gerganov 2024-02-22 23:21:39 +02:00
  • 31891db2e3 ci : fix whitespace Georgi Gerganov 2024-02-22 20:20:34 +02:00
  • 5fdb27ff80 ggml : 32-bit arm compat (#1891) Georgi Gerganov 2024-02-22 18:31:40 +02:00
  • 6b16927d18 sync : ggml Georgi Gerganov 2024-02-22 15:15:38 +02:00
  • ce411498f6 sync : llama.cpp (ggml/0) Georgi Gerganov 2024-02-21 16:19:39 +02:00