Commit Graph

  • 4200430e75 tests : re-enable tests [no ci] (#2977) Daniel Bevenius 2025-03-31 17:04:37 +02:00
  • e153b8eaa2 android.java : re-add ggml source updates (#2975) Daniel Bevenius 2025-03-31 16:14:33 +02:00
  • 83af237f0b ci : re-enable freeBDS-latest job (#2973) Daniel Bevenius 2025-03-31 15:24:08 +02:00
  • 7a2e39750a ci : re-enable android_java job (#2958) Daniel Bevenius 2025-03-31 15:14:24 +02:00
  • 0a40ae9728 android : add new ggml source files Georgi Gerganov 2025-03-31 14:38:43 +03:00
  • 32cfdcbf42 ruby : add new ggml sources Georgi Gerganov 2025-03-31 14:19:25 +03:00
  • cfa42aca09 sync : ggml Georgi Gerganov 2025-03-31 14:13:54 +03:00
  • 2e2f0f954b SYCL: Remove misleading ggml_sycl_op_flatten function (llama/12387) Akarshan Biswas 2025-03-31 14:55:24 +05:30
  • 93631b2be6 metal : use constexpr in FA kernels + fix typedef (llama/12659) Georgi Gerganov 2025-03-30 22:04:04 +03:00
  • f9015b585b musa: fix all warnings, re-enable -DLLAMA_FATAL_WARNINGS=ON in ci and update doc (llama/12611) R0CKSTAR 2025-03-30 16:59:38 +08:00
  • 1880ffd7ff cmake : fix ccache conflict (llama/12522) Jay 2025-03-29 18:04:58 +08:00
  • 9173932c78 cpu : rm unused variable (ggml/1166) Xuan-Son Nguyen 2025-03-29 11:59:56 +01:00
  • 94c3f3877f cpu: de-duplicate some of the operators and refactor (ggml/1144) cmdr2 2025-03-29 11:37:13 +05:30
  • 00086469fb cmake: improve Vulkan cooperative matrix support checks (#2966) Sandro Hanea 2025-03-31 12:44:36 +02:00
  • 2d8e40e2a0 examples : update README links to point to pages deployment (#2971) Daniel Bevenius 2025-03-31 12:32:27 +02:00
  • e17af6524f ci : add github pages workflow for wasm examples (#2969) Daniel Bevenius 2025-03-31 11:34:40 +02:00
  • 88d13a17a7 feat: add health check endpoint to server (#2968) Sacha Arbonel 2025-03-31 10:03:41 +02:00
  • f92bd59951 whisper : remove unnecessary GGML_UNUSED macro (#2960) Daniel Bevenius 2025-03-30 05:56:10 +02:00
  • 6e7629b146 sync : ggml Georgi Gerganov 2025-03-28 20:58:21 +02:00
  • 27533e7f63 metal : improve FA + improve MoE (llama/12612) Georgi Gerganov 2025-03-28 20:21:59 +02:00
  • 1b81415963 vulkan: fix coopmat shader generation when cross-compiling (llama/12272) Icenowy Zheng 2025-03-29 01:51:06 +08:00
  • 0001ec075f llamafile : ppc64le GEMV forwarding for FP32. (llama/12594) amritahs-ibm 2025-03-28 13:13:22 +05:30
  • 5bad2e5099 rpc : send hash when tensor data is above some fixed threshold (llama/12496) Radoslav Gerganov 2025-03-28 08:18:04 +02:00
  • 6fc0ae2f5a opencl: add multi and vision rope, gelu_quick and im2col (llama/12600) lhez 2025-03-27 08:08:08 -07:00
  • de6b38c6d9 bindings.go : add DetectedLanguage to go bindings (#2947) Amanda Der Bedrosian 2025-03-28 04:26:22 -07:00
  • 46d6e0abc1 ruby : fix test failures in test_whisper (#2955) Daniel Bevenius 2025-03-28 09:29:56 +01:00
  • 1279f0d0bc examples : support progress_callback API for addon.node (#2941) Lin Xiaodong 2025-03-28 13:34:26 +08:00
  • f28bf5d186 xcf : fix visionOS build Georgi Gerganov 2025-03-27 10:30:09 +02:00
  • 1fbdfb1d36 files : remove old wkv6 (#0) Georgi Gerganov 2025-03-27 10:15:02 +02:00
  • ee5581633b sync : ggml Georgi Gerganov 2025-03-27 10:13:47 +02:00
  • 8ca67df291 ggml : sync/merge cmake,riscv,powerpc, add common.cmake (ggml/0) Georgi Gerganov 2025-03-27 09:12:54 +02:00
  • fc6d343e76 llamafile : ppc64le MMA implementation for Q4_0. (llama/12489) amritahs-ibm 2025-03-27 12:21:47 +05:30
  • 3199356d3a SYCL: implement memset ggml backend buffer interface (llama/12580) Akarshan Biswas 2025-03-27 07:16:00 +05:30
  • e0c43b0bbf HIP: Add support for RDNA4 targets (llama/12372) Slobodan Josic 2025-03-26 23:46:30 +01:00
  • f4f619ea8e metal : refactor mat-vec code (llama/12569) Georgi Gerganov 2025-03-26 21:38:38 +02:00
  • 3c4d363872 ggml : fix MUL_MAT_ID repack with Q8_K (llama/12544) Georgi Gerganov 2025-03-26 13:02:00 +02:00
  • 15aa189329 ggml-cpu : update KleidiAI to v1.5.0 (llama/12568) Dan Johansson 2025-03-25 12:10:18 +01:00
  • c53d5c9e85 SYCL: disable Q4_0 reorder optimization (llama/12560) Akarshan Biswas 2025-03-25 16:10:18 +05:30
  • ba6f584f30 opencl: simplify kernel embedding logic in cmakefile (llama/12503) lhez 2025-03-24 09:20:47 -07:00
  • a219941812 CUDA: Fix clang warnings (llama/12540) R0CKSTAR 2025-03-24 18:28:34 +08:00
  • a2cc8c2666 vulkan: fix mul_mat_vec failure in backend tests (llama/12529) Jeff Bolz 2025-03-24 01:56:17 -05:00
  • 388ed98220 ggml : fix quantized cpy op (llama/12310) Georgi Gerganov 2025-03-22 16:23:26 +02:00
  • d487a28ae1 musa: refine compute capability (llama/12493) R0CKSTAR 2025-03-22 17:11:37 +08:00
  • cbb88c4050 vulkan: Optimize mul_mat_vec p021 and nc shaders (llama/12505) Jeff Bolz 2025-03-22 03:40:11 -05:00
  • 13455c0b5f Vulkan: RTE rounding for cpy to quant (llama/12480) stduhpf 2025-03-21 20:34:50 +01:00
  • 2f77a9e9bd vulkan: workaround for AMD Windows driver 16 bit unpack8 bug (llama/12472) Eve 2025-03-21 19:27:47 +00:00
  • fa2b5249ff Fix build on Windows when ccache enabled (ggml/9954) (llama/9976) 蕭澧邦 2025-03-21 14:58:47 +08:00
  • 5b854ebba5 sycl: cleanup oneDNN related code (llama/12097) Svetlozar Georgiev 2025-03-21 02:15:56 +00:00
  • 8058f19d0b ggml : block interleaving support for Q4_K quantization for x86 AVX2 architecture (llama/12332) Srihari-mcw 2025-03-20 17:05:34 +05:30
  • ae6a9bb9a5 CUDA: Improve flash decoding kernel GPU occupancy for BS=1 case (llama/12183) Gaurav Garg 2025-03-20 01:22:06 +05:30
  • 24faba9e9b vulkan: optimize iq1 coopmat2 dequant functions (llama/12427) Jeff Bolz 2025-03-19 13:56:23 -05:00
  • c722ff84d3 Fix visionOS build and add CI (llama/12415) Guus Waals 2025-03-19 10:15:23 +00:00
  • 102af79f63 vulkan: Submit once enough matmul work has been recorded (llama/12406) Jeff Bolz 2025-03-19 02:26:26 -05:00
  • 03c364557d opencl: improve profiling (llama/12442) lhez 2025-03-18 12:54:55 -07:00
  • 31b62276cf musa: override warp_size of musa device to 32 (llama/12445) R0CKSTAR 2025-03-19 02:28:26 +08:00
  • 97b5a3055d SYCL: using graphs is configurable by environment variable and compile option (llama/12371) Łukasz Ślusarczyk 2025-03-18 11:16:31 +01:00
  • 9993c3f703 ggml : add SVE support for q6_K_q8_K (llama/12361) fj-y-saito 2025-03-18 17:14:39 +09:00
  • fa72479cfb Vulkan: Default to 1GB allocations instead of 4GB to avoid fragmentation and driver issues (llama/12434) 0cc4m 2025-03-18 07:21:40 +01:00
  • 6c15539c54 fixed compilation warnings in ggml-sycl (llama/12424) Łukasz Ślusarczyk 2025-03-18 01:51:25 +01:00
  • 52c4c03b0a llama: Add support for RWKV v7 architecture (llama/12412) Molly Sophia 2025-03-18 07:27:50 +08:00
  • cfc2560e41 cuda : enable CUDA Graph on CUDA Toolkit < 12.x (llama/12394) Gaurav Garg 2025-03-17 23:55:13 +05:30
  • db6e8056b5 ggml-vulkan: remove unused find_program(glslc) (llama/12416) Guus Waals 2025-03-18 00:35:43 +08:00
  • b3f3779c1b vulkan: Add N/2 and N/4 optimized paths in coopmat2 shader (llama/12312) Jeff Bolz 2025-03-17 09:26:18 -05:00
  • 13eeebb1b2 vulkan: subgroup size tuning (llama/12087) Daniele 2025-03-17 12:42:33 +01:00
  • 905b834af1 vulkan: use fp32 in coopmat2 q4_k dequant function (llama/12309) Jeff Bolz 2025-03-17 04:43:35 -05:00
  • 2cd3061a23 vulkan: Pad N dimension of B matrix for coopmat2 perf, to avoid bounds checking (llama/12273) Jeff Bolz 2025-03-17 04:41:59 -05:00
  • 88d59e21b2 vulkan: Adjust coopmat2 tile sizes and selection heuristic (llama/12258) Jeff Bolz 2025-03-17 04:35:00 -05:00
  • 4917f122d4 cmake : enable building llama.cpp using system libggml (llama/12321) Christian Kastner 2025-03-17 10:05:23 +01:00
  • 16a1b77249 SYCL: set extras only on GGML_TYPE_Q4_0 (llama/12366) Akarshan Biswas 2025-03-17 07:15:12 +05:30
  • 51d1398a0a SYCL: Delete redundant plus sign and space (llama/12391) aubreyli 2025-03-15 22:49:03 +08:00
  • 3499dd83c0 SYCL : support non-contiguous tensors in binary ops (add, sub, etc) (llama/12399) fairydreaming 2025-03-15 15:19:30 +01:00
  • 7b7d9ae35e MUL_MAT optimization (llama/12382) Chenguang Li 2025-03-15 09:31:08 +08:00
  • 2dcb7181ff sycl : variable sg_size support for mmvq kernels (llama/12336) Alberto Cabrera Pérez 2025-03-12 09:57:32 +00:00
  • 96ab3b2465 CUDA/HIP: Fix fattn-vec-* when device warp size is not 32 (llama/12315) uvos 2025-03-12 10:14:11 +01:00
  • 08f32992d0 vulkan: fix bug in coopmat1 mul_mat_id (llama/12316) Jeff Bolz 2025-03-12 00:59:19 -05:00
  • 394fae57c3 CUDA/HIP: refractor mmqv to unify the calculation of nwarps and rows per block between host and device code. (llama/12177) uvos 2025-03-11 20:16:03 +01:00
  • 0708835301 ggml-backend : fix backend search path (llama/12330) jklincn 2025-03-11 21:25:17 +08:00
  • 774c519433 metal : Cache the Metal library at the device context level (llama/12265) BB-fat 2025-03-11 19:45:02 +08:00
  • 776cdceb9e mat vec double buffer (llama/12188) Eve 2025-03-10 19:28:11 +00:00
  • 03d050481e musa: support new arch mp_31 and update doc (llama/12296) R0CKSTAR 2025-03-11 01:18:25 +08:00
  • 3d60219622 opencl: use OpenCL C standard supported by the device (llama/12221) Henry Linjamäki 2025-03-10 18:57:00 +02:00
  • 521d72d76e ggml-backend : make path_str compatible with C++20 (llama/12269) Jason C.H 2025-03-09 00:02:39 +08:00
  • 9fb9025a40 ggml : skip intermediate .air file when compiling .metallib (llama/12247) Daniel Bevenius 2025-03-07 14:15:27 +01:00
  • 3c2abb01e8 cmake: Enable specifying exact PowerPC CPU architecture (ggml/1138) Christian Kastner 2025-03-10 19:19:58 +01:00
  • efd9407e22 cmake: Comment out GGML_BIN_DIR for now (ggml/1139) Christian Kastner 2025-03-10 13:06:21 +01:00
  • 3684af2594 scripts : update sync Georgi Gerganov 2025-03-27 10:13:26 +02:00
  • 206459a804 bindings-go : update Makefile to use cmake (#2952) Daniel Bevenius 2025-03-26 16:21:07 +01:00
  • 21d890d534 whisper : add support for backends with multiple ggml_backend_buffer_type (#2863) Dan Johansson 2025-03-26 15:54:02 +01:00
  • 0b43a02be8 bindings.java : enable copyLibs task [no ci] (#2949) Daniel Bevenius 2025-03-26 15:01:28 +01:00
  • 2699e1485a bindings.javascript : update test instructions [no ci] (#2951) Daniel Bevenius 2025-03-26 14:49:12 +01:00
  • 594a121f3e readme : add note about SDL2 (#2946) Page-MS 2025-03-26 03:30:59 -04:00
  • 996581c5e2 whisper.android : add GGML_USE_CPU compile definition (#2945) Daniel Bevenius 2025-03-25 18:01:18 +01:00
  • 226d344f56 whisper.android.java : update build with ggml source changes (#2942) Daniel Bevenius 2025-03-25 16:01:59 +01:00
  • bb9f68129f ci: fix SYCL build (#2943) Akarshan Biswas 2025-03-25 14:50:37 +05:30
  • 30cf30ca82 examples : reduce initial memory to 512MB (#2939) Daniel Bevenius 2025-03-24 14:42:12 +01:00
  • ee6286c35d examples : fix nthread parsing in whisper.wasm (#2938) Daniel Bevenius 2025-03-24 14:40:00 +01:00
  • c7941d5ccc examples : fix request path for local worker files (#2937) Daniel Bevenius 2025-03-24 14:33:45 +01:00
  • b82ac32a6c ggml : add logging for native build options/vars (#2935) Daniel Bevenius 2025-03-24 09:53:38 +01:00
  • edf1ee1ef8 whisper : enhance model download scripts functionality and resolve compiler warning (#2925) Peter 2025-03-24 19:39:50 +11:00
  • cf5ddb8c21 whisper : initialize decoder's rng with unique seed (#2932) Daniel Bevenius 2025-03-24 09:36:07 +01:00