Commit Graph

  • e1dbf9a42e SYCL: Add ROPE vision kernel (llama/12887) Akarshan Biswas 2025-04-15 14:07:42 +05:30
  • ee0013865d ggml : Add AVX512 implementation of GEMM - Q4_Kx8 (llama/12829) Srihari-mcw 2025-04-15 11:52:36 +05:30
  • 32a407166b CANN: Opt ROPE optimization (llama/12865) Chenguang Li 2025-04-15 10:09:35 +08:00
  • 622f981853 CANN: Optimize CANN buffer pool memory management (llama/12875) Xinpeng Dou 2025-04-15 10:04:24 +08:00
  • d049d67065 SYCL: Fix im2col (llama/12910) Akarshan Biswas 2025-04-14 17:53:53 +05:30
  • 877308838e rpc : use ggml_context_ptr (llama/12938) Radoslav Gerganov 2025-04-14 13:59:34 +03:00
  • d87dfcf7c0 ggml : Depthwise 2D convolution (ggml/1152) Acly 2025-04-17 14:16:45 +02:00
  • 915c14ef10 ggml: use _mm[512/256]_dpbusd[_avx]_epi32 to directly accumulate into the result register (llama/12773) SXX 2025-04-14 13:47:55 +08:00
  • 5d33d3c929 ggml: disable CUDA graphs for unsupported DUP and CONT node types (llama/12891) Alan Gray 2025-04-13 22:12:21 +01:00
  • 751e42b21e vulkan: use aligned loads for flash attention mask (llama/12853) Jeff Bolz 2025-04-12 03:44:48 -05:00
  • e8ee32d12d sycl: Support sycl_ext_oneapi_limited_graph (llama/12873) Ewan Crawford 2025-04-11 15:32:14 +02:00
  • e9ce285135 SYCL: Add fp16 type support to unary op kernels (llama/12788) Akarshan Biswas 2025-04-11 13:33:50 +05:30
  • b942f451b6 ggml: fix compilation error s390x (llama/12848) Aaron Teo 2025-04-11 13:20:07 +08:00
  • e6410faf99 cpu: fix cpu backend's supports-op for GET_ROWS_BACK. fixes a fatal when running test-backend-ops with only the CPU backend (ggml/1190) cmdr2 2025-04-11 12:14:19 +05:30
  • 182df69384 CANN: Support more ops (llama/12841) Chenguang Li 2025-04-10 08:51:52 +08:00
  • 3bf9691dfd Fixes #12823 (llama/12830) Prajwal B Mehendarkar 2025-04-10 04:48:01 +05:30
  • ba444e9c23 ggml-cpu-impl.h: do not redefine bool on POWER9 (llama/12856) Piotr Kubaj 2025-04-09 23:00:34 +00:00
  • c6caf8eef2 ggml-impl.h: fix build on POWER9 (llama/12855) Piotr Kubaj 2025-04-09 23:00:25 +00:00
  • 6cae79a1d7 CANN: Support Opt CONV_TRANSPOSE_1D and ELU (llama/12786) Chenguang Li 2025-04-09 14:04:14 +08:00
  • b9bfe0c693 vulkan: In coopmat2 mmq, load q4_k/q5_k scales through shared memory (llama/12833) Jeff Bolz 2025-04-09 00:25:08 -05:00
  • 1d50c6ac22 vulkan: Use fp16 for the flash attention P*V multiplication (llama/12783) Jeff Bolz 2025-04-09 00:12:57 -05:00
  • 79f23d9132 cuda : add f32 to bf16 copy op (llama/12806) Sigbjørn Skjæret 2025-04-08 23:21:31 +02:00
  • ee2cbeeb74 llama : fix FA when KV cache is not used (i.e. embeddings) (llama/12825) Georgi Gerganov 2025-04-08 19:54:51 +03:00
  • 868a5ce310 ggml: don't include arm_neon.h when using CUDA 12 with ARM Neon (ggml/1187) cmdr2 2025-04-10 17:53:08 +05:30
  • b9c71fae5a ggml : add bilinear upscale support (ggml/1185) Diego Devesa 2025-04-09 12:32:13 +02:00
  • 6d67c6d93d ggml : add more generic custom op, remove deprecated custom ops (ggml/1183) Diego Devesa 2025-04-09 12:31:34 +02:00
  • 12cade118e Revert "sycl:remove redundant memcopy in function ggml_backend_sycl_buffer_set_tensor" (llama/12812) Neo Zhang Jianyu 2025-04-08 15:03:21 +08:00
  • fd1c725e65 opencl: better identify Adreno GPU (llama/12760) lhez 2025-04-07 13:22:54 -07:00
  • d33fd00cfe cuda : fix HIP and MUSA BF16 (llama/0) Georgi Gerganov 2025-04-07 13:18:07 +03:00
  • 3e0d89782a sycl: remove redundant memcopy in function ggml_backend_sycl_buffer_set_tensor (llama/12734) zhouwg 2025-04-07 23:22:57 +08:00
  • 7074b622eb CANN: fix typo in ggml-cann (llama/12733) zhouwg 2025-04-07 19:34:14 +08:00
  • b8d3e45342 CANN: Refactor to reduce duplicate code (llama/12731) hipudding 2025-04-07 17:10:36 +08:00
  • 1901505138 musa: fix compilation warnings in mp_22/31 (llama/12780) R0CKSTAR 2025-04-06 21:23:54 +08:00
  • 3c26dd3353 vulkan: fix NaN issue in flash attention shader (llama/12776) Jeff Bolz 2025-04-06 04:03:47 -05:00
  • d792d2a2dc vulkan: Use unclamped loads for flash attention mask (llama/12720) Jeff Bolz 2025-04-06 03:47:13 -05:00
  • 8add58aa5e Vulkan: Tune Vulkan mmq int dot shader for performance (llama/12767) 0cc4m 2025-04-05 18:04:03 +02:00
  • 8f8ede1b12 sycl: allow ggml-sycl configuration and compilation using Visual Studio project/solution (llama/12625) Nicolò Scipione 2025-04-04 16:00:46 +02:00
  • 3a6fe8d767 cmake: fix ggml-shaders-gen compiler paths containing spaces (llama/12747) Ronny Brendel 2025-04-04 15:12:40 +02:00
  • 76231bda56 vulkan: Hybrid waitForFences/getFenceStatus to reduce fence latency (llama/12630) Jeff Bolz 2025-04-04 00:54:35 -05:00
  • 785437c253 vulkan: set cmake minimum and project name in vulkan-shaders (llama/12744) Jeff Bolz 2025-04-04 00:53:20 -05:00
  • 2f0612cb1c CUDA: Prefer vector flash decoding kernel for Gemma models (llama/12738) Gaurav Garg 2025-04-03 21:50:29 +05:30
  • e944065d5b vulkan: Fix missing cmake logic for dot product extension (llama/12721) Jeff Bolz 2025-04-03 10:08:26 -05:00
  • ccc7b5df0b fix MUSA compiler warning (llama/12704) a3sh 2025-04-03 15:32:55 +08:00
  • fbed36851e CANN: Support operator SIN COS ARGMAX (llama/12709) Chenguang Li 2025-04-03 15:18:08 +08:00
  • d1d847f184 Simplify and improve CUDA graphs through use of indirect copy pointers (llama/9017) Alan Gray 2025-04-03 02:31:15 +01:00
  • 337f91d4a6 CANN: Fix failed test cases (llama/12708) hipudding 2025-04-03 08:49:51 +08:00
  • 317a0031f9 opencl: use max_alloc_size in backend ctx instead of querying again (llama/12705) lhez 2025-04-02 17:01:42 -07:00
  • b243416918 vulkan: Implement split_k for coopmat2 flash attention. (llama/12627) Jeff Bolz 2025-04-02 14:25:08 -05:00
  • 6e532c7187 cmake: remove caching from vulkan coopmat checks (llama/12719) bandoti 2025-04-02 14:56:26 -03:00
  • 2105b110d3 vulkan: Implement grouped query attention in the coopmat2 FA shader (llama/12559) Jeff Bolz 2025-04-02 12:40:32 -05:00
  • f82622180f Vulkan: Fix mmq int dot float cache size (llama/12722) 0cc4m 2025-04-02 19:12:30 +02:00
  • a71c64512a llama : add option to override model tensor buffers (llama/11397) Diego Devesa 2025-04-02 14:52:01 +02:00
  • 1e9c2f87f1 ggml : simplify Arm fp16 CPU logic (ggml/1177) Georgi Gerganov 2025-04-07 12:25:15 +03:00
  • 06ce8f83e6 CUDA: don't convert BF16 weights to FP32 (ggml/1174) Sigbjørn Skjæret 2025-04-04 21:05:12 +02:00
  • 8b92060a10 coreml : set convert_to="mlprogram" in convert Daniel Bevenius 2025-04-23 08:24:38 +02:00
  • 7858eddd10 ci : disable freeBSD job in build.yml (#3064) Daniel Bevenius 2025-04-22 11:07:54 +02:00
  • 3a88f1e504 examples : add HEAPU8 to exported runtime methods (#3062) Daniel Bevenius 2025-04-20 19:40:25 +02:00
  • f0d2bfbfb7 ruby : make Ruby bindings installed with build options (#3056) KITAITI Makoto 2025-04-17 18:49:58 +09:00
  • 170b2faf75 whisper : add no_context parameter to whisper_params (#3045) Sacha Arbonel 2025-04-16 06:24:38 +02:00
  • f8a3509b6d examples : add FFmpeg v7.0 support to ffmpeg-transcode.cpp (#3038) Fujimoto Seiji 2025-04-15 13:09:00 +09:00
  • 2a2d21c75d ruby: use CMake in build process (#3043) KITAITI Makoto 2025-04-14 18:18:27 +09:00
  • 9cfcd6cc45 docs : update README.md to note newer nvidia gpus (#3031) Jeff Klassen 2025-04-11 00:54:51 -06:00
  • e853620270 addon.node : support max_context api for addon.node (#3025) Lin Xiaodong 2025-04-11 12:36:38 +08:00
  • 549db9376f whisper : reduce delta_min from 1000ms to 100ms (#3028) Georgi Gerganov 2025-04-11 07:23:02 +03:00
  • 33a25e4dda docs : document how to use 'WHISPER_FFMPEG' build option (#3029) Fujimoto Seiji 2025-04-11 01:21:38 +09:00
  • 43f5030aeb docs : fix README.md (#3024) Ekaitz Zárraga 2025-04-09 19:49:37 +02:00
  • cf794133de xcf : use check for visionos build version (#3021) Daniel Bevenius 2025-04-09 16:34:58 +02:00
  • ef6cf357e7 ruby : fix types of arguments for rb_get_kwargs in ruby_whisper_params.c (#3022) Olli 2025-04-09 13:49:25 +02:00
  • b1f5c11b32 ruby : Update uri.rb (#3016) Olli 2025-04-08 15:27:40 +02:00
  • ada745f4a5 models : fix dead link to models in readme (#3006) Greg Sadetsky 2025-04-06 01:29:41 -04:00
  • 01985c22c0 ruby : change homepage URI in Ruby gemspec (#3007) KITAITI Makoto 2025-04-05 13:55:09 +09:00
  • 448f3d3b93 tests : add script to benchmark whisper.cpp on LibriSpeech corpus (#2999) Fujimoto Seiji 2025-04-05 01:51:26 +09:00
  • e6234cd435 whisper : fix "bench-all outputs an invalid result on larger models" (#3002) Fujimoto Seiji 2025-04-05 00:36:19 +09:00
  • 2b6d0d2200 rename : ggerganov -> ggml-org (#3005) Georgi Gerganov 2025-04-04 16:11:52 +03:00
  • 0b17d4507e examples : update server.py to match github pages app [no ci] (#3004) Daniel Bevenius 2025-04-04 10:23:53 +02:00
  • 77e0c86ab6 whisper.wasm : fix unknown language issue (#3000) Daniel Bevenius 2025-04-03 19:50:47 +02:00
  • eac1bc9c47 examples : add new sources Georgi Gerganov 2025-04-02 15:24:02 +03:00
  • cbde66d913 sync : ggml Georgi Gerganov 2025-04-02 15:23:55 +03:00
  • 513ecf8dc0 cpu: move all the operators into a separate c++ file (except mul_mat) (ggml/1167) cmdr2 2025-04-02 17:46:16 +05:30
  • cce5daf17b docs : add xcframework section to README.md [no ci] (#2997) Daniel Bevenius 2025-04-03 09:06:53 +02:00
  • 2c502b3c00 readme : update roadmap link Georgi Gerganov 2025-04-02 17:38:35 +03:00
  • 51c6961c7b release : v1.7.5 Georgi Gerganov 2025-04-02 16:31:22 +03:00
  • 503a786c9a bench : update numbers [no ci] (#2993) Georgi Gerganov 2025-04-02 16:27:36 +03:00
  • ad4e350933 sync : ggml Georgi Gerganov 2025-04-02 15:13:40 +03:00
  • d7a9346ab1 get_rows and dup optimization (llama/12671) Chenguang Li 2025-04-02 15:22:13 +08:00
  • b63d23f728 opencl : fix memory allocation size (llama/12649) Junil Kim 2025-04-02 01:54:34 +09:00
  • f6ce10e4a1 metal : use F32 prec in FA kernels (llama/12688) Georgi Gerganov 2025-04-01 14:57:19 +03:00
  • 6cb2b86581 Fix clang warning in gguf_check_reserved_keys (llama/12686) R0CKSTAR 2025-04-01 19:12:53 +08:00
  • 801d6bd809 vulkan: fix build when glslc doesn't support coopmat (llama/12683) Wagner Bruna 2025-04-01 06:38:07 -03:00
  • ddf7e6a15d SYCL: Rename oneMKL to oneMath (llama/12192) Romain Biessy 2025-04-01 10:24:29 +02:00
  • 0d42097fd3 SYCL: switch to SYCL namespace (llama/12674) Akarshan Biswas 2025-04-01 13:41:39 +05:30
  • 842b9c984c ggml : faster ssm scan (llama/10558) a3sh 2025-04-01 00:05:13 +08:00
  • 0810f02547 Vulkan: Add DP4A MMQ and Q8_1 quantization shader (llama/12135) 0cc4m 2025-03-31 14:37:01 +02:00
  • 8c13c78f9d cmake : fix whitespace (llama/0) Georgi Gerganov 2025-03-31 15:05:30 +03:00
  • f31b404fcb tests : remove gh label test-whisper-cli-tiny-en (#2988) Daniel Bevenius 2025-04-02 10:50:31 +02:00
  • 854c0518bc examples : clarify Core ML encoder model usage [no ci] (#2987) Daniel Bevenius 2025-04-02 08:32:14 +02:00
  • c8e3968edd ci : remove intermediate build on push to master (#2986) Daniel Bevenius 2025-04-02 08:29:28 +02:00
  • b358de2458 whisper.objc : fix typo in README.md [no ci] (#2985) Daniel Bevenius 2025-04-02 08:26:57 +02:00
  • 11688b262f coreml: fix Whisper to CoreML conversion by disabling SDPA [no ci] (#2979) Daniel Bevenius 2025-04-01 18:01:23 +02:00
  • 04b9508fb3 ci : add coreml job that converts base.en to coreml [no ci] (#2981) Daniel Bevenius 2025-04-01 17:04:32 +02:00