Commit Graph

  • 7fe4979f25 ci : remove CMAKE_CUDA_ARCHITECTURES in windows-cublas (#2923) Daniel Bevenius 2025-03-22 15:40:28 +01:00
  • 9bc0dc7235 whisper : update default model download directory behavior to use current working directory when script is in /bin/ directory (#2924) Peter 2025-03-23 01:27:57 +11:00
  • 3fc6ad97a3 whisper.swiftui : Add Core ML support to README [no ci] (#2921) Daniel Bevenius 2025-03-21 11:38:32 +01:00
  • 663cafc1e8 readme : update Python version to 3.11 for Core ML support [no -ci] (#2919) Daniel Bevenius 2025-03-21 10:31:55 +01:00
  • be9de81171 whisper : add check for CPU backend initialization (#2918) Daniel Bevenius 2025-03-21 09:53:26 +01:00
  • 21fb513ef1 examples : update whisper.objc README.md (#2916) Daniel Bevenius 2025-03-21 09:52:53 +01:00
  • 4e56747944 ci : increase windows-cublas evict-old-files to 5d (#2915) Daniel Bevenius 2025-03-21 08:19:24 +01:00
  • ca75449a92 xcframework : add support for CoreML to ios/macOS (#2912) Daniel Bevenius 2025-03-20 18:39:08 +01:00
  • 80dad86b2c examples : add WHISPER_SDL2 check to deprecation executables (#2911) Daniel Bevenius 2025-03-20 18:36:02 +01:00
  • 485ece6725 ci : use ninja and fix caching for windows-cublas (#2910) Daniel Bevenius 2025-03-20 17:01:48 +01:00
  • e7d9d8687a examples : update wasm examples to include server.py [no ci] (#2908) Daniel Bevenius 2025-03-20 09:07:43 +01:00
  • 6e8242f7fe examples : command.wasm updates (#2904) Daniel Bevenius 2025-03-20 07:02:18 +01:00
  • e27fd6f0c0 ci : refactor cuda toolkit installation steps (#2902) Daniel Bevenius 2025-03-19 09:41:14 +01:00
  • 96db0c5a9c go : add Encoder Begin Callback (#2900) Amanda Der Bedrosian 2025-03-19 00:05:04 -07:00
  • d2aaffd5d9 ci : add ccache action to windows-cublas job (#2893) Daniel Bevenius 2025-03-19 04:53:08 +01:00
  • 215990abde whisper : fix compiler warnings in whisper.cpp (#2895) Daniel Bevenius 2025-03-18 13:38:41 +01:00
  • 7e23d8c64a ci : add missing env.branch_name to build.yml (#2896) Daniel Bevenius 2025-03-18 13:38:21 +01:00
  • 740bf7f6a1 whisper : enable compiler warnings for src (#2891) Daniel Bevenius 2025-03-18 05:19:18 +01:00
  • c8e12f59dd ci : add release job and include xcframework (#2889) Daniel Bevenius 2025-03-18 05:18:20 +01:00
  • 83b14c357c examples : use xcframework in whisper.objc example (#2882) Daniel Bevenius 2025-03-17 13:01:24 +01:00
  • 60b481d881 whisper : add option to use system-installed GGML (#2887) Peter 2025-03-17 18:54:48 +11:00
  • 4854789751 convert : update convert-h5-to-ggml.py (#2840) Anders Bjarby 2025-03-17 08:41:05 +01:00
  • e0f3c9d4dd examples : add GGML_USE_CPU=ON flag to whisper.objc (#2880) Daniel Bevenius 2025-03-14 15:40:20 +01:00
  • 1f4886b40d ggml-ci: update input env variables to GG_BUILD_ (#2879) Benjamin Ryan 2025-03-14 03:53:29 -05:00
  • f11de0e73c ggml-ci: add run.sh (#2877) Benjamin Ryan 2025-03-14 02:29:55 -05:00
  • d5cc27ee4d examples : add dl to the list of libraries linked (#2875) Daniel Bevenius 2025-03-14 04:42:20 +01:00
  • 5bb1d58c6a whisper: add xcframework build script (#2873) Martin Destagnol 2025-03-13 02:56:39 -10:00
  • 7d14005717 objc : fix build, tmp remove GPU support, use C++17 Georgi Gerganov 2025-03-08 10:46:37 +02:00
  • 4ffb8e3e4d cmake : fix ggml-config (ggml/0) Georgi Gerganov 2025-03-08 10:33:33 +02:00
  • 1d8d8ae55e sync : ggml Georgi Gerganov 2025-03-08 10:26:00 +02:00
  • eebf6bc0bd ggml-cpu: faster AVX2 variant for IQ1_M (llama/12216) Rémy O 2025-03-07 12:54:22 +01:00
  • dc8f423b40 metal : simplify kernel arguments using a struct (ggml/3229) (llama/12194) BB-fat 2025-03-07 15:35:57 +08:00
  • 548e7052f1 metal : fix default.metallib build (llama/12224) Daniel Bevenius 2025-03-07 06:23:16 +01:00
  • a34cb73dc2 opencl: Noncontiguous norm, rms_norm, disable fp16 for some ops (llama/12217) lhez 2025-03-06 16:20:35 -08:00
  • 82f9496657 cmake : fix undefined reference errors for std::filesystem in ggml (#12092) (llama/12094) xiaofei 2025-03-07 06:58:25 +08:00
  • e3c85e75bd CUDA: fix FA logic for PTX 7.0 and CC >= 7.5 (llama/12222) Johannes Gäßler 2025-03-06 18:45:09 +01:00
  • b9eab73fa2 HIP/CUDA: set the paramerter value in maintain_cuda_graph instead of replaceing it. (llama/12209) uvos 2025-03-06 08:20:52 +01:00
  • 76385c8311 opencl : fix buffer alignment (llama/12197) Henry Linjamäki 2025-03-06 03:33:40 +02:00
  • 442cd1d2e7 opencl : fix ulong kernel args were set from int variables (llama/12174) Henry Linjamäki 2025-03-06 03:31:14 +02:00
  • bc8cb97e02 opencl : fix profile-related errors (llama/12095) simon886212 2025-03-06 09:30:05 +08:00
  • 8dcadf736b ggml-cpu: Faster IQ1 mul_mat_vec on AVX2 using BMI2 instructions (llama/12154) Rémy O 2025-03-06 02:26:10 +01:00
  • 93986b61e0 SYCL: Disable f16 Unary OPs as not supported by the kernels (llama/12201) Akarshan Biswas 2025-03-05 21:28:23 +05:30
  • bd1a9e34c9 ggml : fix GGMLMetalClass ODR (llama/12200) Plamen Minev 2025-03-05 17:16:01 +02:00
  • cc03608e78 ggml : ggml_compute_forward_concat() for arbitrary tensor type (ggml/1118) vmobilis 2025-03-07 11:11:40 +03:00
  • 54a54faee4 vulkan : sync (llama/0) Georgi Gerganov 2025-03-04 21:08:15 +02:00
  • 96a92ecc4c ggml : portability fixes for VS 2017 (llama/12150) mgroeber9110 2025-03-04 17:53:26 +01:00
  • edd1d8686a HIP: implement FlashAttention via rocWMMA for CDNA and RDNA3+ (llama/12032) David Huang 2025-03-04 05:10:54 +08:00
  • dc6f4e7c05 ggml : fix kleidiai build (llama/12159) ag2s20150909 2025-03-03 20:54:08 +08:00
  • 74c85d154e SYCL: Move CPY kernels to a separate file and add few missing kernels (llama/12133) Akarshan Biswas 2025-03-03 15:37:22 +05:30
  • eb2d8b6ffd ggml-backend : keep paths in native string type when possible (llama/12144) Diego Devesa 2025-03-02 22:11:00 +01:00
  • b442dcd598 CUDA: compress mode option and default to size (llama/12029) Erik Scholz 2025-03-01 12:57:22 +01:00
  • c98681e6d5 ggml : upgrade init_tensor API to return a ggml_status (llama/11854) William Tambellini 2025-02-28 05:41:47 -08:00
  • 3bab804981 vulkan: add specific MMV kernels for IQ2 and IQ3 quants + optimizations (llama/11595) Rémy O 2025-02-28 09:42:52 +01:00
  • c927830a70 CUDA: fix logic for V100 + GGML_CUDA_FORCE_MMQ (llama/12098) Johannes Gäßler 2025-02-28 09:26:43 +01:00
  • 992b51b3d5 ggml: aarch64: implement SVE kernels for q2_k_q8_k vector dot (llama/12064) Prashant Vithule 2025-02-28 13:06:12 +05:30
  • 2c882cbe4c CANN: Fix build error with GCC 13 (llama/11990) hipudding 2025-02-28 15:23:47 +08:00
  • 1fbb119b1e vulkan: matmul dequantization improvements (llama/12015) Eve 2025-02-28 07:20:08 +00:00
  • 40dea850fd vulkan: improve im2col (llama/11826) Daniele 2025-02-28 06:52:51 +00:00
  • 8255a830a8 cmake: Fix ggml backend dependencies and installation (llama/11818) Vladimir Vuksanovic 2025-02-27 08:42:48 +01:00
  • a0f76b2da7 vulkan: fix assertion when qy_needs_dequant (llama/12068) Jeff Bolz 2025-02-25 09:30:21 -06:00
  • 394768c48b ggml-cpu: Fix build with sve (llama/12059) Molly Sophia 2025-02-25 19:28:22 +08:00
  • 846e01b2c0 cuda: unary ops as float + de-duplicate (ggml/1130) cmdr2 2025-03-03 20:51:31 +05:30
  • 6ac8e6b2ce cuda/vulkan: specify fp32-only support for some operations in supports_op (ggml/1129) cmdr2 2025-02-28 15:59:55 +05:30
  • 60d2ddebdf cuda/cpu: Increase support for fp16 unary operations (ggml/1125) cmdr2 2025-02-28 12:34:39 +05:30
  • 2e180184a8 Told cmake to install ggml-cpp.h as a public header file. (ggml/1126) petterreinholdtsen 2025-02-26 21:44:00 +01:00
  • ef40950c4a common : more general m_audio_len update logic (#2855) Ivy233 2025-03-07 16:10:03 +08:00
  • c774eec709 go : improve model download (#2756) Ryan Johnson 2025-03-07 02:03:51 -06:00
  • 5b481a27a6 common : fix audio loading by miniaudio (#2862) Dmitry Atamanov 2025-03-04 22:05:21 +05:00
  • fc7b1ee521 fix: missing include common-whisper (#2858) Lin Xiaodong 2025-03-03 02:55:11 +08:00
  • c42f67e2d2 ruby : follow audio library change (#2851) KITAITI Makoto 2025-02-28 15:09:02 +09:00
  • 339a1cba5d whisper : support GGML_BACKEND_DL (#2843) Diego Devesa 2025-02-27 13:35:07 +01:00
  • c64f3e8ada common : separate whisper sources (#2846) Georgi Gerganov 2025-02-27 12:50:32 +02:00
  • 9f83f67221 common : fix build min/max (#2845) Georgi Gerganov 2025-02-27 10:39:13 +02:00
  • 7d3da68f79 examples : use miniaudio for direct decoding flac, mp3, ogg and wav (#2759) Dmitry Atamanov 2025-02-27 12:06:54 +05:00
  • b5d21359c1 stream : stop on ^C when no audio is received (#2822) petterreinholdtsen 2025-02-27 07:59:51 +01:00
  • 17addf7104 sync : ggml Georgi Gerganov 2025-02-26 22:39:12 +02:00
  • cdaee8b4bd Support pure float16 add/sub/mul/div operations in the CUDA (and CPU) backend (ggml/1121) cmdr2 2025-02-25 18:06:34 +05:30
  • 4b60ff4f92 metal : copy kernels for quant to F32/F16 conversions (llama/12017) Gian-Carlo Pascutto 2025-02-25 10:27:58 +01:00
  • b43b9d928c opencl: fix for small models (llama/11950) lhez 2025-02-24 13:47:07 -08:00
  • e3cb412a59 Optimize mul_mat for Q4_0 on Intel GPU (llama/12035) Neo Zhang Jianyu 2025-02-24 22:33:23 +08:00
  • ac301a7d9b SYCL: Fix GGML_SYCL_DEBUG macro (llama/11995) Akarshan Biswas 2025-02-24 15:48:25 +05:30
  • 82e04e7670 ggml-cpu: Support s390x SIMD Instruction Set (llama/12019) Aaron Teo 2025-02-23 05:39:24 +08:00
  • 38ac47cd4d CUDA: app option to compile without FlashAttention (llama/12025) Johannes Gäßler 2025-02-22 20:44:34 +01:00
  • 2d70cd36d7 CUDA: optimize FA for GQA + large batches (llama/12014) Johannes Gäßler 2025-02-22 12:20:17 +01:00
  • 98dab49b9a cuda: Add Q5_1, Q5_0, Q4_1 and Q4_0 to F32 conversion support. (llama/12000) Gian-Carlo Pascutto 2025-02-22 09:43:24 +01:00
  • b1385e9aa9 CUDA: correct the lowest Maxwell supported by CUDA 12 (llama/11984) PureJourney 2025-02-21 19:21:05 +08:00
  • 48f5e893f5 MUSA: support ARM64 and enable dp4a .etc (llama/11843) Bodhi 2025-02-21 15:46:23 +08:00
  • dc21871fcb ggml-cpu: Add CPU backend support for KleidiAI library (llama/11390) Charles Xu 2025-02-20 14:06:51 +01:00
  • 64a430bc81 ggml: aarch64: implement SVE kernels for q3_K_q8_K vector dot (llama/11917) Prashant Vithule 2025-02-20 15:38:32 +05:30
  • 51a3580c79 CUDA: use async data loading for FlashAttention (llama/11894) Johannes Gäßler 2025-02-17 14:03:24 +01:00
  • 37a21dd43d vulkan: implement several ops relevant for ggml_opt (llama/11769) Rémy O 2025-02-17 07:55:57 +01:00
  • 8a22a8b17f vulkan: support multi/vision rope, and noncontiguous rope (llama/11902) Jeff Bolz 2025-02-16 01:52:23 -06:00
  • fcbcad0c90 metal : fix the crash caused by the lack of residency set support on Intel Macs. (llama/11904) Hale Chan 2025-02-16 14:50:26 +08:00
  • 4444db7360 metal : optimize dequant q6_K kernel (llama/11892) Adrian Kretz 2025-02-15 19:39:20 +01:00
  • a7fc1038ca repo : update links to new url (llama/11886) Georgi Gerganov 2025-02-15 16:40:57 +02:00
  • 1689aaf854 vulkan: initial support for IQ1_S and IQ1_M quantizations (llama/11528) Rémy O 2025-02-15 09:01:40 +01:00
  • 4b48fe449a opencl: Fix rope and softmax (llama/11833) lhez 2025-02-14 11:12:23 -08:00
  • 47cc043e69 cuda : add ampere to the list of default architectures (llama/11870) Diego Devesa 2025-02-14 15:33:52 +01:00
  • e3d9ffb98b ggml: optimize some vec dot functions for LoongArch ASX (llama/11842) Jinyang He 2025-02-14 16:54:27 +08:00
  • e22d69839d vulkan: linux builds + small subgroup size fixes (llama/11767) Eve 2025-02-14 02:59:40 +00:00