Mintplex-Labs/whisper.cpp
1
0
Fork 0
mirror of https://github.com/Mintplex-Labs/whisper.cpp.git synced 2026-07-22 00:45:27 -04:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • 4b19cc3ed4 cuda : non-cont concat support (llama/7610) Georgi Gerganov 2024-05-29 15:38:26 +03:00
  • a535d348dd llama-bench : add support for the RPC backend (llama/7435) Radoslav Gerganov 2024-05-29 14:45:44 +03:00
  • 8f5dc729d9 ggml : use atomic_flag for critical section (llama/7598) slaren 2024-05-29 13:36:39 +02:00
  • 02fc147a0b examples : adapt to new ggml_concat (ggml/0) Georgi Gerganov 2024-05-29 12:58:00 +03:00
  • 109148ac84 ggml : fix typo in ggml.c (llama/7603) zhouwg 2024-05-29 10:09:31 +08:00
  • 3563473d2c Align GEMM dispatch (llama/7566) Meng, Hengyu 2024-05-29 07:00:24 +08:00
  • 046834198d sycl : fix assert (llama/7563) Georgi Gerganov 2024-05-28 22:22:50 +03:00
  • 0a2ad9de06 vulkan: properly initialize vulkan devices for LLAMA_SPLIT_MODE_NONE (llama/7552) k.h.lai 2024-05-29 01:25:08 +08:00
  • 39b0640b09 rpc : resource management rework (llama/7562) Radoslav Gerganov 2024-05-28 18:13:36 +03:00
  • 8dca71de64 fix ggml_sycl_mul_mat_id() to match the change of api (llama/7436) Neo Zhang 2024-05-28 17:53:37 +08:00
  • 812787cbc5 ggml : generalize GGML_OP_CONCAT (llama/7563) Georgi Gerganov 2024-05-28 11:04:19 +03:00
  • 68ef10805e update HIP_UMA #7399 (llama/7414) Djip007 2024-05-28 01:40:47 +02:00
  • 96fdb90f5f Allow multiple copy function pointers for CUDA graph kernel param updates (llama/7565) agray3 2024-05-27 18:33:42 +01:00
  • e98f9ac554 Fix q_xxs using mul_mat_q (llama/7459) AidanBeltonS 2024-05-27 17:34:51 +01:00
  • 02d481595b Add freq factors (llama/7495) AidanBeltonS 2024-05-27 13:34:09 +01:00
  • 7091c7ab5a metal : add GGML_OP_REPEAT kernels (llama/7557) Georgi Gerganov 2024-05-27 12:10:19 +03:00
  • d70ccb75f5 metal : disable FA kernel for HS=256 (llama/7556) Georgi Gerganov 2024-05-27 10:38:39 +03:00
  • 5ee048eb67 ggml : restore ggml_rope_xpos_inplace (ggml/0) Georgi Gerganov 2024-05-26 18:35:23 +03:00
  • 37ed71c964 ggml: aarch64: SVE kernels for q8_0_q8_0, q4_0_q8_0 vector dot (llama/7433) Masaya, Kato 2024-05-25 17:42:31 +09:00
  • 8cd7a3df37 ggml : silence UB sanitizer error during iq2_xxs quantization (llama/0) Georgi Gerganov 2024-05-23 17:17:43 +03:00
  • 04a3279320 ggml : remove ggml_flash_attn and ggml_flash_ff (llama/7463) Georgi Gerganov 2024-05-23 10:00:44 +03:00
  • 45ddda8e0c ggml : drop support for QK_K=64 (llama/7473) Georgi Gerganov 2024-05-23 10:00:21 +03:00
  • c41317fd66 Update vulkan rope implementation to support frequency factors (llama/7475) 0cc4m 2024-05-23 08:59:59 +02:00
  • 96b8419b27 CUDA: fix FA out-of-bounds reads (llama/7479) Johannes Gäßler 2024-05-23 00:31:20 +02:00
  • 3c63f4cf35 CUDA: fix FA out-of-bounds writes (llama/7465) Johannes Gäßler 2024-05-22 17:58:25 +02:00
  • 5848dfd9c8 cuda : fix compile warning (llama/7454) Georgi Gerganov 2024-05-22 12:36:37 +03:00
  • 29ab5d0326 CUDA: remove incorrect precision check (llama/7454) Johannes Gäßler 2024-05-22 10:24:29 +02:00
  • c4d6958b3e cuda : fix rope + add tests (llama/7452) Georgi Gerganov 2024-05-22 11:01:35 +03:00
  • c9dcb75118 llama : add phi3 128K model support (llama/7225) liuwei-git 2024-05-22 04:28:32 +08:00
  • bbdbc3fc62 metal : handle F16 inf values, fix FA partial offload (llama/7434) Georgi Gerganov 2024-05-21 23:03:42 +03:00
  • 28c207a541 CUDA: fix unused warning in mmq.cu (llama/7442) Johannes Gäßler 2024-05-21 19:27:12 +02:00
  • c23f830983 CUDA: deduplicate mmq code (llama/7397) Johannes Gäßler 2024-05-21 16:02:12 +02:00
  • caeeb32b41 rpc : track allocated buffers (llama/7411) Radoslav Gerganov 2024-05-20 16:36:55 +03:00
  • 584cc1177a Update SYCL upscale operation (llama/7321) AidanBeltonS 2024-05-20 12:08:23 +01:00
  • cc1ae10989 ggml-opencl, llama: using reserve() if count already known (llama/7272) Herman Semenov 2024-05-20 07:33:21 +00:00
  • eb26f55b40 ggml : add loongarch lsx and lasx support (llama/6454) junchao-loongson 2024-05-20 15:19:21 +08:00
  • eb2b086584 Add provisions for windows support for BF16 code including CMake provision for enabling AVX512_BF16 (llama/7258) Srihari-mcw 2024-05-19 19:18:39 -07:00
  • 67919cfe11 Vulkan Embedding Fix (llama/7360) 0cc4m 2024-05-19 17:19:53 +02:00
  • bf5fc81a8a ggml : fix another case of quants nans (llama/7387) slaren 2024-05-19 17:08:46 +02:00
  • 2b07dc3186 ggml: implement quantized KV cache for FA (llama/7372) Johannes Gäßler 2024-05-19 16:46:13 +02:00
  • 951c463d39 cuda : clear error after buffer allocation failure (llama/7376) slaren 2024-05-19 14:19:37 +02:00
  • 7f257b210f Capture CUDA logging output (llama/7298) fraxy-v 2024-05-19 01:44:42 +03:00
  • 705fe30a02 android : use "ci-android" branch for CI (llama/7341) Georgi Gerganov 2024-05-18 13:40:39 +03:00
  • 45b5b95e29 CUDA: deduplicate FlashAttention code (llama/7352) Johannes Gäßler 2024-05-18 12:36:25 +02:00
  • f2c47d1e6a cuda : add half2 __shfl_xor() for ROCm 5.5 (llama/7263) Engininja2 2024-05-18 02:05:17 -06:00
  • b4bb9b9036 Update and fix Vulkan soft_max and argsort implementations (llama/7237) 0cc4m 2024-05-18 08:10:58 +02:00
  • 2bc6483299 ggml : fix quants nans when all the group weights are very close to zero (llama/7313) slaren 2024-05-18 02:39:54 +02:00
  • ec52f900e4 CUDA: faster large batch FA without tensor cores (llama/7314) Johannes Gäßler 2024-05-17 18:54:52 +02:00
  • 77d708fabb rpc : set SO_REUSEADDR for the server socket (llama/7320) Radoslav Gerganov 2024-05-17 17:25:44 +03:00
  • c00149c861 ggml-quants, llama : removed excess checks (llama/7274) Herman Semenov 2024-05-17 07:08:49 +00:00
  • 574661f2e6 ggml : rewrite silu and softmax for cpu (llama/7154) Justine Tunney 2024-05-17 02:58:52 -04:00
  • 7bd69349bf rpc : add command line arg for specifying backend memory Radoslav Gerganov 2024-05-15 15:29:07 +03:00
  • 488ad99c13 Add support for properly optimized Windows ARM64 builds with LLVM and MSVC (llama/7191) Max Krasnyansky 2024-05-15 19:47:36 -07:00
  • 7178cceeaa ggml : use dynamic thread scheduling for matrix multiplication (llama/6915) kunnis 2024-05-15 12:59:12 -05:00
  • 8d55ccdb8c Avoid unnecessarily disabling CUDA graphs (llama/7302) agray3 2024-05-15 14:44:49 +01:00
  • 37a72cb170 ggml : tag ggml_tensor::backend as deprecated (llama/7290) slaren 2024-05-15 15:08:48 +02:00
  • bf9b69284f Add missing " (llama/7303) AidanBeltonS 2024-05-15 13:26:30 +01:00
  • c4de1e19df ggml : add ggml_upscale_ext (ggml/814) John Balis 2024-05-15 03:52:33 -05:00
  • 5b7073cae1 scripts : update sync Georgi Gerganov 2024-06-16 12:41:42 +03:00
  • b29b3b2924 whisper : use ggml-cuda in mel calc, set appropriate device (#2236) Borislav Stanimirov 2024-06-13 13:16:07 +03:00
  • 420b6abc54 cuda : fix HIPBLAS build (#2234) Georgi Gerganov 2024-06-11 19:14:38 +03:00
  • 99804b0f3e cuda : fix bounds check for src0 rows in MMVQ kernel (#2231) Georgi Gerganov 2024-06-11 17:39:01 +03:00
  • c55964c956 ci : fix CUDA builds (#2232) Georgi Gerganov 2024-06-11 17:21:30 +03:00
  • 20c542c713 whisper : auto-grow working areas for mel_calc_cuda (#2227) Borislav Stanimirov 2024-06-10 21:51:32 +03:00
  • c2bdb960cd whisper : free whisper_mel instances (#2220) Georgi Gerganov 2024-06-10 10:59:36 +03:00
  • 87acd6d629 whisper : whisper_state/backend fixes (#2217) Georgi Gerganov 2024-06-06 18:51:36 +03:00
  • f842d31171 whisper : calculate mel spectrogram directly into a ggml_tensor (#2208) Borislav Stanimirov 2024-06-06 16:20:46 +03:00
  • ffef323c4c whisper : add CUDA-specific computation mel spectrograms (#2206) Borislav Stanimirov 2024-06-04 09:32:23 +03:00
  • af5833e298 whisper : remove speed_up and phase_vocoder* functions (#2198) Borislav Stanimirov 2024-05-31 11:37:29 +03:00
  • b87494bb8f readme : add conan badge (#2196) Martin Delille 2024-05-30 14:43:28 +02:00
  • ad130431aa readme : add install instructions for Conan (#2189) Carlos Zoido 2024-05-30 14:06:15 +02:00
  • e130b66642 whisper: use global cache for sin/cos vals and Hann window (#2194) Borislav Stanimirov 2024-05-29 19:09:21 +03:00
  • c7b6988678 release : v1.6.2 Georgi Gerganov 2024-05-27 10:35:09 +03:00
  • 05042a782d Revert "whisper : remove extra backend instance (huh?)" (#2182) Georgi Gerganov 2024-05-27 10:20:25 +03:00
  • a7dc2aab16 server : fix typo (#2181) Daniel Valdivia 2024-05-25 00:46:22 -07:00
  • 22d46b7ba4 ruby : update bindings (#2154) Todd 2024-05-22 16:02:52 -04:00
  • c10db6ea28 release : v1.6.1 Georgi Gerganov 2024-05-21 18:44:37 +03:00
  • 1b51fdf170 examples : add support for decoding input with ffmpeg (Linux) (#2133) William Tambellini 2024-05-21 08:31:41 -07:00
  • adee3f9c1f node : add flash_attn param (#2170) Pedro Probst 2024-05-20 03:08:48 -03:00
  • 4798be1f9a ci: Update build.yml to suppress warnings about node.js versions (#2166) Tamotsu Takahashi 2024-05-19 17:49:26 +09:00
  • 08981d1bac release : v1.6.0 Georgi Gerganov 2024-05-15 09:59:48 +03:00
  • 7094ea5e75 whisper : use flash attention (#2152) Georgi Gerganov 2024-05-15 09:38:19 +03:00
  • 9d5771ae43 talk-llama : reject runs without required arguments (#2153) petterreinholdtsen 2024-05-14 20:32:41 +02:00
  • f56b8305c4 sync : ggml Georgi Gerganov 2024-05-14 19:16:32 +03:00
  • 1056ad762c metal : support FA without mask + add asserts (llama/7278) Georgi Gerganov 2024-05-14 19:09:30 +03:00
  • c451080c8b ggml : add RPC backend (llama/6829) Radoslav Gerganov 2024-05-14 14:27:19 +03:00
  • 8e7c22fbdb rm wait() (llama/7233) Neo Zhang 2024-05-13 18:11:26 +08:00
  • e57e95eb0d CUDA: add FP32 FlashAttention vector kernel (llama/7188) Johannes Gäßler 2024-05-12 19:40:45 +02:00
  • 130f43e4b8 scripts : sync ggml-rpc Georgi Gerganov 2024-05-14 19:15:35 +03:00
  • d8356a1cc2 whisper : fix model path encoding in windows (#2086) thewh1teagle 2024-05-14 09:43:41 +03:00
  • 4ef8d9f44e server : return utf-8 (#2138) Georgi Gerganov 2024-05-13 15:33:46 +03:00
  • 3928dbd206 node : add audio_ctx and audio buffer params (#2123) Pedro Probst 2024-05-13 09:22:23 -03:00
  • 2ced6f0742 cmake : fix HIP/ROCm build (#2102) aldorof 2024-05-13 08:18:43 -04:00
  • 30f73109b8 node : add additional params (#2000) valVk 2024-05-13 15:15:43 +03:00
  • 17fa62d3d3 js : remove un-needed request header from fetchRemote (#2119) Mark Karpelès 2024-05-13 21:13:19 +09:00
  • 1da5edcde0 cmake : fix metal embed sources path (#2110) Georgi Gerganov 2024-05-13 15:09:35 +03:00
  • 0bb05b113d main : dont print timings with --no-prints (#2108) Daniel Ziegenberg 2024-05-13 14:00:19 +02:00
  • f141b2b938 main : add options for temperature control (#2088) Daniel Ziegenberg 2024-05-13 13:59:44 +02:00
  • 2b434c449e whisper : switch back to F32 mask (#0) Georgi Gerganov 2024-05-13 14:43:43 +03:00
  • e93081f83f whisper.android : update example, add field to print timestamp (#2072) zhangjixiong 2024-05-13 19:30:03 +08:00