Commit Graph

  • 2a29afd4c6 vulkan : argsort barriers must be under uniform control flow (ggml/951) Salvatore Mesoraca 2024-09-26 08:59:42 +02:00
  • 5963004ff9 ggml : fix GGML_MAX_N_THREADS + improve formatting (ggml/969) Georgi Gerganov 2024-09-24 13:23:59 +03:00
  • ede1718f6d server : ffmpeg overwrite leftover temp file (#2431) gilbertgong 2024-10-02 05:06:40 -07:00
  • 2ef717b293 whisper : add large-v3-turbo (#2440) Georgi Gerganov 2024-10-01 15:57:06 +03:00
  • 8feb375fbd tests : remove test-backend-ops (#2434) Georgi Gerganov 2024-09-27 11:48:33 +03:00
  • 69339af2d1 ci : disable failing CUDA and Java builds Georgi Gerganov 2024-09-25 10:03:34 +03:00
  • 0d2e2aed80 readme : fix references to download-ggml-model.sh (#2427) Hugo 2024-09-24 20:07:51 +02:00
  • 451e9ee92c make : remove "talk" target until updated Georgi Gerganov 2024-09-24 14:15:09 +03:00
  • 1133ac98a8 ggml : add ggml-cpu-impl.h (skip) (#0) Georgi Gerganov 2024-09-24 13:27:33 +03:00
  • 76d27eec9a sync : ggml Georgi Gerganov 2024-09-24 13:23:04 +03:00
  • fe18c29ab8 talk-llama : sync llama.cpp Georgi Gerganov 2024-09-24 13:22:55 +03:00
  • 234f9bd320 ggml : add AVX512DQ requirement for AVX512 builds (llama/9622) Eric Zhang 2024-09-24 16:03:21 +08:00
  • 3b183cfae7 log : add CONT level for continuing previous log entry (llama/9610) Georgi Gerganov 2024-09-24 10:15:35 +03:00
  • 02285dff81 threads: fix msvc build without openmp (llama/9615) Max Krasnyansky 2024-09-23 21:18:48 -07:00
  • 2fc1d20f9e cuda: add q8_0->f32 cpy operation (llama/9571) Ivan 2024-09-24 03:14:24 +03:00
  • 08e8414f27 threads: improve ggml_barrier scaling with large number of threads (llama/9598) Max Krasnyansky 2024-09-23 11:42:43 -07:00
  • 05c6139625 ggml : AVX512 gemm for Q4_0_8_8 (llama/9532) Srihari-mcw 2024-09-23 19:36:38 +05:30
  • 896c41ef30 metal : use F32 prec for K*Q in vec FA (llama/9595) Georgi Gerganov 2024-09-23 11:27:47 +03:00
  • c36ddc43c6 Revert "[SYCL] fallback mmvq (ggml/9088)" (llama/9579) Akarshan Biswas 2024-09-23 08:58:06 +05:30
  • 13f41af43e musa: enable building fat binaries, enable unified memory, and disable Flash Attention on QY1 (MTT S80) (llama/9526) R0CKSTAR 2024-09-22 22:55:49 +08:00
  • 3fc5306b82 Fix merge error in #9454 (llama/9589) Molly Sophia 2024-09-22 21:26:50 +08:00
  • adf2474b10 CUDA: enable Gemma FA for HIP/Pascal (llama/9581) Johannes Gäßler 2024-09-22 09:34:52 +02:00
  • 008816a257 RWKV v6: RWKV_WKV op CUDA implementation (llama/9454) Molly Sophia 2024-09-22 10:29:12 +08:00
  • 33e5a6612e ggml-alloc : fix list of allocated tensors with GGML_ALLOCATOR_DEBUG (llama/9573) slaren 2024-09-21 14:24:23 +02:00
  • f0a7d65b3d Update CUDA graph on scale change plus clear nodes/params (llama/9550) agray3 2024-09-21 01:41:07 +01:00
  • 54e5095765 examples : adapt to ggml.h changes (ggml/0) Georgi Gerganov 2024-09-20 21:50:16 +03:00
  • 34291099fb ggml : refactoring (llama/#0) Georgi Gerganov 2024-09-20 21:24:06 +03:00
  • d245d7aec7 ggml : fix builds (llama/0) Georgi Gerganov 2024-09-20 20:12:52 +03:00
  • d661283e68 ggml : fix trailing whitespace (llama/0) Georgi Gerganov 2024-09-20 19:13:02 +03:00
  • c0761c95f5 CUDA: fix sum.cu compilation for CUDA < 11.7 (llama/9562) Johannes Gäßler 2024-09-20 18:35:35 +02:00
  • 138e20b697 ggml : fix n_threads_cur initialization with one thread (llama/9538) slaren 2024-09-18 19:13:08 +02:00
  • a8d9abfa22 threadpool : skip polling for unused threads (llama/9461) Max Krasnyansky 2024-09-17 01:19:46 -07:00
  • 195afd6dc1 ggml : link MATH_LIBRARY not by its full path (llama/9339) Michael Podvitskiy 2024-09-16 13:06:50 +02:00
  • 1fd78999e8 cmake : do not hide GGML options + rename option (llama/9465) Georgi Gerganov 2024-09-16 10:27:50 +03:00
  • 374e9e0c5e ggml : IQ4_NL sgemm + Q4_0 AVX optimization (llama/9422) Eve 2024-09-16 06:48:24 +00:00
  • a2cb5b4183 metal : handle zero-sized allocs (llama/9466) Georgi Gerganov 2024-09-16 09:05:56 +03:00
  • 288ae5176e common : reimplement logging (llama/9418) Georgi Gerganov 2024-09-15 20:46:12 +03:00
  • d868122a5a cmake : correct order of sycl flags (llama/9497) Michael Podvitskiy 2024-09-15 18:55:52 +02:00
  • 2ba25fb122 cmake : try to fix sycl+intel build (llama/9487) Michael Podvitskiy 2024-09-15 09:06:38 +02:00
  • 4f4687cb74 ggml : ggml_type_name return "NONE" for invalid values (llama/9458) Yuri Khrustalev 2024-09-14 05:54:37 -04:00
  • 66b00fad0d cmake : use list(APPEND ...) instead of set() + dedup linker (llama/9463) Georgi Gerganov 2024-09-14 10:55:05 +03:00
  • c6cc8d16c3 cann: Add host buffer type for Ascend NPU (llama/9406) Dou Xinpeng 2024-09-12 19:46:43 +08:00
  • 3f8f8a78a2 riscv : modify Makefile and add a RISCV_VECT to print log info (llama/9442) Ahmad Tameem 2024-09-12 16:24:31 +05:00
  • 3e47686919 cann: Fix error when running a non-exist op (llama/9424) Xinpeng Dou 2024-09-12 09:02:35 +08:00
  • a53b69a003 CUDA: fix --split-mode row race condition (llama/9413) Johannes Gäßler 2024-09-11 10:22:40 +02:00
  • d1c9b47360 musa: remove Clang builtins mapping (llama/9421) R0CKSTAR 2024-09-11 09:46:55 +08:00
  • 32f659861a sycl : update support conditions (llama/9394) Alberto Cabrera Pérez 2024-09-11 01:53:42 +01:00
  • a785232bf9 metal : fix compile warning with GGML_METAL_NDEBUG (llama/0) Georgi Gerganov 2024-09-10 10:17:03 +03:00
  • 0677293503 rpc : fix segfault with nkvo (llama/9389) Radoslav Gerganov 2024-09-09 18:40:10 +03:00
  • 1fbdb813c0 ggml : vector length agnostic SVE support (llama/9290) Prashant Vithule 2024-09-09 21:07:18 +05:30
  • 67725ac8f3 CUDA: fix variable name conflict for Windows build (llama/9382) Johannes Gäßler 2024-09-09 14:22:53 +02:00
  • dac89af357 Overlap cmdbuffer creation and cmdbuffer execution in Vulkan backend by submitting smaller cmdbuffers early. (llama/9118) Markus Tavenrath 2024-09-08 21:43:48 +02:00
  • 26225f1fb0 cuda : fix FA Q src index (1 -> 0) (llama/9374) Georgi Gerganov 2024-09-08 22:01:02 +03:00
  • 3468983315 add check malloc result on device (llama/9346) Neo Zhang Jianyu 2024-09-08 19:05:29 +08:00
  • c7515b0995 ggml/examples: add backend support for numerical optimization (ggml/949) Johannes Gäßler 2024-09-20 14:36:38 +02:00
  • 253ce30004 examples : add null threadpool args where needed (ggml/0) Georgi Gerganov 2024-09-08 11:10:43 +03:00
  • 03a6fae484 metal : update support condition for im2col + fix warning (llama/0) Georgi Gerganov 2024-09-08 09:57:57 +03:00
  • d37fd275fd ggml : always check bounds on get_rows operations (llama/9354) slaren 2024-09-07 20:23:07 +02:00
  • 195877fd72 ggml : fix missing cpu_set_t on emscripten (llama/9336) Xuan Son Nguyen 2024-09-07 12:01:34 +02:00
  • 9e715e1b96 Improve Vulkan shader build system (llama/9239) Markus Tavenrath 2024-09-06 08:56:17 +02:00
  • 6f5514b6e2 ggml-quants : ternary packing for TriLMs and BitNet b1.58 (llama/8151) compilade 2024-09-05 21:48:47 -04:00
  • 709a22b92d cuda : fix defrag with quantized KV (llama/9319) slaren 2024-09-05 11:13:11 +02:00
  • 01e214a1d7 ggml : AVX2 support for Q4_0_8_8 (llama/8713) Srihari-mcw 2024-09-04 22:21:22 +05:30
  • 1cecfe6a02 Fix DMMV dequantization (llama/9279) Ouadie EL FAROUKI 2024-09-04 16:26:33 +01:00
  • 3764bc974c ggml : add pthread includes on FreeBSD (llama/9258) yuri@FreeBSD 2024-09-02 08:25:30 -07:00
  • fcffc912a9 llama : support RWKV v6 models (llama/8980) Molly Sophia 2024-09-01 22:38:17 +08:00
  • 38d40b9972 Threadpool: take 2 (llama/8672) Faisal Zaghloul 2024-08-29 19:20:53 -04:00
  • 09149ee0ae vulkan: fix compilation with GGML_VULKAN_DEBUG=ON (ggml/948) Salvatore Mesoraca 2024-09-06 14:34:33 +02:00
  • 6b7f37dd5c vulkan: add dryrun support to sin and cos ops (ggml/947) Salvatore Mesoraca 2024-09-06 14:34:25 +02:00
  • 791812fb54 vulkan: correctly report support for OP_CONT (ggml/946) Salvatore Mesoraca 2024-09-06 14:34:07 +02:00
  • 5d6dc19f04 tests: add gradient tests for all backends (ggml/932) Johannes Gäßler 2024-09-03 17:21:46 +02:00
  • 34972dbe22 go : add temperature options (#2417) Binozo 2024-09-20 14:45:36 +02:00
  • bea43e0c64 docker : add libsdl2-dev for container builds (#2424) JohnnyB 2024-09-20 13:36:43 +01:00
  • 3853d83d73 go : add tests and update bindings (#2425) Stavros Panakakis 2024-09-20 15:36:12 +03:00
  • 5b1ce40fa8 server : use OS-generated temp file name for converted files (#2419) Toliver 2024-09-17 21:56:32 +09:00
  • 049b3a0e53 go : fix CUDA build (#2416) Binozo 2024-09-15 11:23:56 +02:00
  • a551933542 cann : add Ascend NPU instructions (#2410) Mengqing Cao 2024-09-11 20:59:24 +08:00
  • 5caa19240d cmake: Fix libdir value in pkgconfig file (#2407) Philippe Normand 2024-09-07 09:18:17 +01:00
  • 5236f02784 revert : cmake : set MSVC to use UTF-8 on source files (#2346) Georgi Gerganov 2024-09-02 11:16:30 +03:00
  • 2abaf19e0d sync : ggml Georgi Gerganov 2024-09-02 10:39:59 +03:00
  • 6eb7a0ffbd ggml: fix ggml_graph_cpy undefined behavior (ggml/943) Johannes Gäßler 2024-08-31 14:35:42 +02:00
  • e8f0f9b5f0 cann : fix doxy (ggml/0) Georgi Gerganov 2024-08-28 18:45:01 +03:00
  • d8e24b877d vulkan : fix build (llama/0) Georgi Gerganov 2024-08-27 22:10:58 +03:00
  • cc68f31577 cuda : mark BF16 CONT as unsupported Georgi Gerganov 2024-08-28 17:08:03 +03:00
  • 4a4a52bf98 ggml : fix cont with transposed tensors when one dimension is 1 (ggml/934) Salvatore Mesoraca 2024-08-28 10:23:02 +02:00
  • c96906d84d cmake : set MSVC to use UTF-8 on source files (#2346) Tim Miller 2024-08-30 20:04:04 +09:00
  • 9600fc3eb1 readme : remove invalid flag from Python example (#2396) UsernamesLame 2024-08-30 07:00:38 -04:00
  • e2e55a6fed readme : fix link (#2394) Georgi Gerganov 2024-08-30 13:58:22 +03:00
  • c4e1861d2c go : add beamsize/entropythold/maxcontext to context interface (#2350) hsinhoyeh 2024-08-28 22:09:01 +08:00
  • da9809f243 talk-llama : sync llama.cpp Georgi Gerganov 2024-08-28 11:04:02 +03:00
  • 9d754a56cf whisper : update FA call Georgi Gerganov 2024-08-28 11:02:54 +03:00
  • 8cc90a0e80 sync : ggml Georgi Gerganov 2024-08-28 11:02:42 +03:00
  • 82b5c56f63 sync : vulkan (skip) (llama/0) Georgi Gerganov 2024-08-27 21:48:22 +03:00
  • b2ad484c89 ggml : do not crash when quantizing q4_x_x with an imatrix (llama/9192) slaren 2024-08-26 19:44:43 +02:00
  • d96a17848f metal : separate scale and mask from QKT in FA kernel (llama/9189) Georgi Gerganov 2024-08-26 18:31:02 +03:00
  • 0e7798677a ggml : add SSM Metal kernels (llama/8546) Georgi Gerganov 2024-08-26 17:55:36 +03:00
  • 58a36d2e3b metal : gemma2 flash attention support (llama/9159) slaren 2024-08-26 11:08:59 +02:00
  • 24d8534bd8 CPU/CUDA: Gemma 2 FlashAttention support (llama/8542) Johannes Gäßler 2024-08-24 21:34:59 +02:00
  • 9b16ddd3a5 Add a space to supress a cmake warning (llama/9133) Akarshan Biswas 2024-08-22 19:39:47 +05:30
  • 32f88af17b Add oneDNN primitive support (llama/9091) luoyu-intel 2024-08-22 12:50:10 +08:00