Commit Graph

  • a9d06ce151 models : add q8_0 models to download-ggml-model.sh (#2589) Michael Rienstra 2024-11-28 00:31:54 -08:00
  • 8c6a9b8bb6 ruby : Follow source tree change (#2580) KITAITI Makoto 2024-11-22 00:04:29 +09:00
  • 37c88027e1 whisper : use backend registry (#0) Georgi Gerganov 2024-11-20 15:32:34 +02:00
  • 9db070a3c5 ggml/sched : do not skip views in pre-assignments slaren 2024-11-20 13:25:08 +01:00
  • 7fd8d9c220 whisper : adapt to new ggml (wip) Georgi Gerganov 2024-11-19 19:09:07 +02:00
  • 06e059b8f8 talk-llama : sync llama.cpp Georgi Gerganov 2024-11-19 19:08:57 +02:00
  • c9f49d5f9d sync : ggml Georgi Gerganov 2024-11-19 19:04:21 +02:00
  • f4c1d7df39 ggml : sync resolve (skip) (#0) Georgi Gerganov 2024-11-19 19:03:47 +02:00
  • 339b8e559c Add required ggml-base and backend libs to cmake pkg (llama/10407) bandoti 2024-11-19 12:10:30 -04:00
  • 5f6d6919b4 cuda : fix CUDA_FLAGS not being applied (llama/10403) Diego Devesa 2024-11-19 14:29:38 +01:00
  • 8ee767732f sycl : Add option to set the SYCL architecture for all targets (llama/10266) Romain Biessy 2024-11-19 09:02:23 +01:00
  • 45f1f9144f vulkan: Optimize soft_max (llama/10301) Jeff Bolz 2024-11-19 01:25:17 -06:00
  • 53589c8f12 sycl: Revert MUL_MAT_OP support changes (llama/10385) Alberto Cabrera Pérez 2024-11-19 00:50:04 +00:00
  • 7ac2f17fac cuda : only use native when supported by cmake (llama/10389) Diego Devesa 2024-11-18 18:43:40 +01:00
  • 48862c7b27 vulkan: remove use of null initializer (llama/10372) Jeff Bolz 2024-11-18 08:28:42 -06:00
  • 44f7d9f4e3 metal : fox offset integer overflows in im2col (ggml/1015) Plamen Minev 2024-11-18 15:02:27 +02:00
  • fd12302587 Vulkan: Fix device info output format specifiers (llama/10366) 0cc4m 2024-11-18 11:02:43 +01:00
  • f80bef4630 metal : add GGML_UNARY_OP_ELU kernel (ggml/1018) PAB 2024-11-18 10:02:49 +01:00
  • 161b443514 CUDA: fix MMV kernel being used for FP16 src1 (llama/10357) Johannes Gäßler 2024-11-17 23:20:42 +01:00
  • ef7fbe1c66 CMake: fix typo in comment [no ci] (llama/10360) Johannes Gäßler 2024-11-17 12:59:38 +01:00
  • 0879d3599e llama : only use default buffer types for the KV cache (llama/10358) Diego Devesa 2024-11-17 12:25:45 +01:00
  • 2a444dc5bd metal : refactor kernel args into structs (llama/10238) Georgi Gerganov 2024-11-17 11:23:01 +02:00
  • 45cf1634dc ggml : fix undefined reference to 'getcpu' (llama/10354) FirstTimeEZ 2024-11-17 21:39:22 +13:00
  • dcb2922d1d CUDA: remove DMMV, consolidate F16 mult mat vec (llama/10318) Johannes Gäßler 2024-11-17 09:09:55 +01:00
  • 3c5c751174 CMake: default to -arch=native for CUDA build (llama/10320) Johannes Gäßler 2024-11-17 09:06:34 +01:00
  • 24ad19d0e9 ggml : fix possible buffer use after free in sched reserve (llama/9930) Diego Devesa 2024-11-17 07:31:17 +01:00
  • bd574b05af ggml : inttypes.h -> cinttypes (llama/0) Georgi Gerganov 2024-11-16 23:40:39 +02:00
  • 7e0eafcb1e ggml : adapt AMX to tensor->grad removal (llama/0) Georgi Gerganov 2024-11-16 21:38:01 +02:00
  • 75670ae673 ggml : fix compile warnings (llama/0) Georgi Gerganov 2024-11-16 21:32:41 +02:00
  • d4fcdf602b llamafile : fix include path (llama/0) Georgi Gerganov 2024-11-16 17:58:56 +02:00
  • 1bebb1a116 vulkan: Optimize some mat-vec mul quant shaders (llama/10296) Jeff Bolz 2024-11-16 00:26:57 -06:00
  • ee437cde59 ggml : optimize Q4_0 into Q4_0_X_Y repack (llama/10324) Dan Johansson 2024-11-16 01:53:37 +01:00
  • c1506d38cf Make updates to fix issues with clang-cl builds while using AVX512 flags (llama/10314) Srihari-mcw 2024-11-16 02:57:00 +05:30
  • c9541741e6 ggml: new optimization interface (ggml/988) Johannes Gäßler 2024-11-16 13:49:35 +01:00
  • 6a55015dc4 ggml : remove duplicated sources from the last sync (ggml/1017) Georgi Gerganov 2024-11-15 23:52:31 +02:00
  • 7e86030d4d ggml : fix some build issues slaren 2024-11-15 20:20:54 +01:00
  • 401fbea326 sync : leftovers (ggml/0) Georgi Gerganov 2024-11-15 21:43:41 +02:00
  • 44d1cbdfe9 cmake : restore CMakeLists.txt (llama/10256) Georgi Gerganov 2024-11-15 21:35:51 +02:00
  • 3216efef2e AVX BF16 and single scale quant optimizations (llama/10212) Eve 2024-11-15 11:47:58 +00:00
  • 2c0484ebf7 sycl: Use syclcompat::dp4a (llama/10267) Romain Biessy 2024-11-15 04:09:12 +01:00
  • 3298916e5e backend cpu: add online flow for aarch64 Q4_0 GEMV/GEMM kernels (llama/9921) Charles Xu 2024-11-15 01:28:50 +01:00
  • 746bf2596f ggml : build backends as libraries (llama/10256) Diego Devesa 2024-11-14 18:04:35 +01:00
  • 5f7e094ccb scripts : update sync Georgi Gerganov 2024-11-19 18:59:18 +02:00
  • 6266a9f9e5 release : v1.7.2 Georgi Gerganov 2024-11-19 18:54:22 +02:00
  • d24f981fb2 sycl: fix example build (#2570) Stefan Sydow 2024-11-18 13:57:23 +01:00
  • 01d3bd7d5c ci : use local ggml in Android build (#2567) Georgi Gerganov 2024-11-16 20:45:41 +02:00
  • bb12cd9b77 ggml : tmp workaround for whisper.cpp (skip) (#2565) Georgi Gerganov 2024-11-16 20:19:02 +02:00
  • f02b40bcb4 update : readme Georgi Gerganov 2024-11-15 16:00:10 +02:00
  • 83ac2842bd scripts : fix sync path Georgi Gerganov 2024-11-15 15:24:09 +02:00
  • c4e95fb74d whisper.swiftui : switch Mac dest to Mac (Designed for iPad) (#2562) Jhen-Jie Hong 2024-11-15 21:21:53 +08:00
  • e23721f3fb cmake : fix ppc64 check (#0) Georgi Gerganov 2024-11-15 09:04:34 +02:00
  • c0a9f8ef85 whisper : include ggml-cpu.h (#0) Georgi Gerganov 2024-11-15 11:01:47 +02:00
  • 6477b84eb6 build : fixes Georgi Gerganov 2024-11-15 09:07:53 +02:00
  • 24d706774d talk-llama : sync llama.cpp Georgi Gerganov 2024-11-15 08:41:06 +02:00
  • 5089ab2d6a whisper : fix build (#0) Georgi Gerganov 2024-11-15 08:40:47 +02:00
  • bdbb906817 sync : ggml Georgi Gerganov 2024-11-15 08:40:34 +02:00
  • fa2ebd336e sycl : Fixes to broken builds and test-backend-ops (llama/10257) Alberto Cabrera Pérez 2024-11-13 09:40:57 +00:00
  • 21b01a21b6 vulkan: Optimize contiguous copies (llama/10254) Jeff Bolz 2024-11-13 00:58:57 -06:00
  • b54ce5edc5 vulkan: Throttle the number of shader compiles during the build step. (llama/10222) Jeff Bolz 2024-11-11 11:13:51 -06:00
  • 26a31b78e9 metal : more precise Q*K in FA vec kernel (llama/10247) Georgi Gerganov 2024-11-11 08:39:13 +02:00
  • 14d13c5f9f vulkan: Fix newly added tests for permuted mul_mat and 1D im2col (llama/10226) Jeff Bolz 2024-11-10 05:37:56 -06:00
  • 5e110c2eb5 metal : reorder write loop in mul mat kernel + style (llama/10231) Georgi Gerganov 2024-11-09 11:53:13 +02:00
  • 4a9926d521 metal : fix build and some more comments (llama/10229) Georgi Gerganov 2024-11-09 11:53:02 +02:00
  • ae3c5642d0 metal : fix F32 accumulation in FA vec kernel (llama/10232) Georgi Gerganov 2024-11-09 11:52:45 +02:00
  • e287a3b627 metal : hide debug messages from normal log Georgi Gerganov 2024-11-09 11:21:49 +02:00
  • b890243690 ggml: fix zero division in ‘dne’ calculation in CUDA COUNT_EQUAL operator when ‘ne’ is small (#10213) SXX 2024-11-09 15:35:46 +08:00
  • b7b38f7d68 ggml : optimize llamafile cpu matrix multiplication for ppc64le (llama/10156) amritahs-ibm 2024-11-09 12:47:50 +05:30
  • 9f67aab211 metal : opt-in compile flag for BF16 (llama/10218) Georgi Gerganov 2024-11-08 21:59:46 +02:00
  • 8f0f785d88 metal : improve clarity (minor) (llama/10171) Georgi Gerganov 2024-11-08 18:37:41 +02:00
  • d0b8335789 metal : optimize FA kernels (llama/10171) Georgi Gerganov 2024-11-08 13:47:22 +02:00
  • 1550be79f1 ggml : add ggml-cpu.h to the public headers (llama/10204) Diego Devesa 2024-11-07 18:16:08 +01:00
  • 807f848c2f fix q4_0_8_8 format for corrupted tokens issue (llama/10198) snadampal 2024-11-07 02:02:08 -06:00
  • 42398f13b0 Optimize RWKV6 Operator Naming and Implement Multi-core CPU/ SYCL Acceleration (llama/10133) Zhiyuan Li 2024-11-07 18:19:10 +11:00
  • 31c3482a4e metal : add BF16 support (llama/8439) Georgi Gerganov 2024-11-06 19:53:51 +02:00
  • 50257af686 metal : fix from ptr buffer name (llama/10189) Diego Devesa 2024-11-06 12:10:07 +01:00
  • d111a0987e ggml : adjust is_first_call init value (llama/10193) Georgi Gerganov 2024-11-06 11:20:10 +02:00
  • 915bcd2c63 metal : add quantized FA support (llama/10149) Georgi Gerganov 2024-11-06 10:24:23 +02:00
  • f69c8b6f1b ggml : fix arch check in bf16_to_fp32 (llama/10164) Diego Devesa 2024-11-04 23:17:01 +01:00
  • 8c9044bef0 Q6_K AVX improvements (llama/10118) Eve 2024-11-04 22:06:31 +00:00
  • 5f8e928194 ggml : fix gelu tables initialization (llama/10172) Diego Devesa 2024-11-04 20:06:58 +01:00
  • 25da30bd60 ggml : fix q4xx mat mul, increase ggml_aligned_malloc alignment (llama/10167) Diego Devesa 2024-11-04 17:34:08 +01:00
  • 542734100e fix build break on arm64 linux (llama/10166) snadampal 2024-11-04 09:08:33 -06:00
  • b06b4c0c08 cuda : clear error after changing peer access (llama/10153) Diego Devesa 2024-11-04 13:10:23 +01:00
  • 939d36fb4c metal : simplify f16 and f32 dequant kernels (llama/0) Georgi Gerganov 2024-11-04 13:49:34 +02:00
  • 1471e41180 metal : move dequantize templates to beginning of MSL source (llama/0) Georgi Gerganov 2024-11-04 13:43:32 +02:00
  • 35949192e9 CANN: adjust backend registry refactor. (llama/10158) leo-pony 2024-11-04 19:08:22 +08:00
  • 9c817edb48 ggml : move CPU backend to a separate file (llama/10144) Diego Devesa 2024-11-03 19:34:08 +01:00
  • 24a0feb5d9 metal : minor fixup in FA kernel (llama/10143) Georgi Gerganov 2024-11-03 15:18:40 +02:00
  • 2ab8cce7e3 llama : add simple-chat example (llama/10124) Diego Devesa 2024-11-01 23:50:59 +01:00
  • b40c255e98 llama : use smart pointers for ggml resources (llama/10117) Diego Devesa 2024-11-01 23:48:26 +01:00
  • ec3e16445e vulkan : improve ggml_vk_create_buffer error handling (llama/9898) Shupei Fan 2024-11-02 02:33:14 +08:00
  • 0665168ef3 ggml : remove ggml_scratch (llama/10121) Georgi Gerganov 2024-11-01 12:58:45 +02:00
  • 5f6b992eea build: fix build error in Windows env with OneAPI setup (llama/10107) Zhenwei Jin 2024-11-01 11:09:59 +08:00
  • 3e231ab9cc llama : fix buffer checks for mamba and rwk (llama/10111) Diego Devesa 2024-10-31 22:54:23 +01:00
  • 371bfaca8c ggml : check tensor name lengths in gguf files (llama/10100) Diego Devesa 2024-10-31 11:40:59 +01:00
  • 91e30a3a23 kompute: add mul_mat_q4_k shader (llama/10097) Sergio López 2024-10-31 10:09:52 +01:00
  • 1e122d66f9 kompute: add backend registry / device interfaces (llama/10045) Sergio López 2024-10-30 17:01:52 +01:00
  • 63a4e09a0f ggml : fix memory leaks when loading invalid gguf files (llama/10094) Diego Devesa 2024-10-30 14:51:21 +01:00
  • 75dd198870 ggml : add Q4_0_8_8 RISC-V GEMV and GEMM kernels (llama/10029) xctan 2024-10-30 15:00:40 +08:00
  • 1d48457aa6 llama : refactor model loader with backend registry (llama/10026) Diego Devesa 2024-10-30 02:01:23 +01:00