Commit Graph

  • 307712a903 ggml: Add POOL2D OP for GPU acceleration to the Vulkan backend in the MobileVLM model. (llama/9763) Changyeon Kim 2024-10-29 17:52:56 +09:00
  • fbc9a05ddf musa: workaround for Guilty Lockup in cleaning src0 (llama/10042) R0CKSTAR 2024-10-28 17:02:48 +08:00
  • 28496ac55e cmake : make it possible linking ggml as external lib (ggml/1003) Yuri Khrustalev 2024-11-02 05:09:12 -04:00
  • b1c06c09b0 metal : fix minor string leaks (ggml/1004) Plamen Minev 2024-11-01 16:55:10 +02:00
  • 498ac0dc27 scripts : update sync Georgi Gerganov 2024-11-15 08:34:49 +02:00
  • 03af461de8 ci : fix building workflow for linux/arm64 container (#2555) Raiya Araki 2024-11-15 18:07:17 +09:00
  • f19463ece2 ruby : extend API (#2551) KITAITI Makoto 2024-11-14 04:52:56 +09:00
  • 5f8a086e22 whisper.swiftui : add model download list & bench methods (#2546) Jhen-Jie Hong 2024-11-14 03:51:34 +08:00
  • a28d82e373 ruby : fix the instructions (#2548) Wilson Silva 2024-11-13 19:47:42 +00:00
  • 5ccca19f0c ggml : vulkan logs (#2547) thewh1teagle 2024-11-13 21:47:15 +02:00
  • 300c07b94d examples : fix ffmpeg v5 build (#2543) Stefan Sydow 2024-11-13 20:41:52 +01:00
  • 31aea563a8 whisper : fix extra memory usage (#2534) Vin Misra 2024-11-06 13:02:11 -08:00
  • 0377596b77 whisper : backend registry init before model load Georgi Gerganov 2024-10-31 22:53:46 +02:00
  • c65d0fd3c8 talk-llama : sync llama.cpp Georgi Gerganov 2024-10-31 22:29:22 +02:00
  • d9efb664ac sync : ggml Georgi Gerganov 2024-10-31 22:26:28 +02:00
  • b5b4b0f5de ggml : add AMX backend (llama/8998) Ma Mingfei 2024-10-26 09:43:40 +03:00
  • ab36d02560 metal : support permuted matrix multiplicaions (llama/10033) Georgi Gerganov 2024-10-25 22:26:15 +03:00
  • 6e67749c00 CUDA: fix insufficient buffer clearing for MMQ (llama/10032) Johannes Gäßler 2024-10-24 14:40:23 +02:00
  • ab0385f43b CUDA: fix MMQ for non-contiguous src0, add tests (llama/10021) Johannes Gäßler 2024-10-24 11:09:36 +02:00
  • 10eb603a3c increase cuda_cpy block size (ggml/996) bssrdf 2024-10-23 14:34:00 -04:00
  • a3231b2f2e metal : add POOL2D and fix IM2COL (llama/9943) Jun Hee Yoo 2024-10-23 19:33:45 +09:00
  • 13db492f83 Adapt to dynamically loadable backends mechanism (llama/9970) leo-pony 2024-10-22 16:16:01 +08:00
  • 741c138aa1 ggml : add asserts for type conversion in fattn kernels (llama/9971) Georgi Gerganov 2024-10-21 16:20:46 +03:00
  • 25f9fee6fb rpc : pack only RPC structs (llama/9959) Radoslav Gerganov 2024-10-21 13:35:40 +03:00
  • 7c1570bee6 fix mul_mat_vec_q and *_vec_q error (llama/9939) Neo Zhang Jianyu 2024-10-21 14:26:09 +08:00
  • 4078e4c388 rpc : backend refactoring (llama/9912) Radoslav Gerganov 2024-10-18 14:33:58 +03:00
  • a4a22daa8f Add SYCL Backend registry, device and Event Interfaces (llama/9705) Ouadie EL FAROUKI 2024-10-18 06:46:16 +01:00
  • e1936eb2a5 add amx kernel for gemm (llama/8998) Ma Mingfei 2024-10-18 13:34:36 +08:00
  • 28b044dad9 vulkan : add backend registry / device interfaces (llama/9721) Diego Devesa 2024-10-17 02:46:58 +02:00
  • b8f11a0a17 fix: allocating CPU buffer with size 0 (llama/9917) Gilad S 2024-10-17 02:34:22 +03:00
  • ff5a838099 fix: use vm_allocate to allocate CPU backend buffer on macOS (llama/9875) Gilad S 2024-10-17 01:36:51 +03:00
  • 84713613be CUDA: fix 1D im2col, add tests (ggml/993) Johannes Gäßler 2024-10-18 09:24:44 +02:00
  • ded89c9d08 Fix cann compilation error (llama/9891) leo-pony 2024-10-16 08:51:46 +08:00
  • 042e95d92f Vectorize load instructions in dmmv f16 CUDA kernel (llama/9816) agray3 2024-10-14 01:49:08 +01:00
  • 81110c0174 ggml : move more prints to the ggml log system (llama/9839) Diego Devesa 2024-10-11 15:34:45 +02:00
  • c313723860 rpc : add backend registry / device interfaces (llama/9812) Diego Devesa 2024-10-10 20:14:55 +02:00
  • e69b2371e2 musa: add docker image support (llama/9685) R0CKSTAR 2024-10-11 02:10:37 +08:00
  • 1531259b2c ggml : fix BLAS with unsupported types (llama/9775) Diego Devesa 2024-10-08 14:21:43 +02:00
  • 44bc2767fd ggml : add backend registry / device interfaces to BLAS backend (llama/9752) Diego Devesa 2024-10-07 21:55:08 +02:00
  • bd7ace7adc Update building for Android (llama/9672) Andrew Minh Nguyen 2024-10-07 09:37:31 -07:00
  • 315364d7de ggml : add metal backend registry / device (llama/9713) Georgi Gerganov 2024-10-07 18:27:51 +03:00
  • 80753d4da8 metal : single allocation of encode_async block (llama/9747) Paul Tsochantaris 2024-10-07 13:26:31 +01:00
  • 8f9bdca4c4 ggml-alloc : remove buffer_id from leaf_alloc (ggml/987) Daniel Bevenius 2024-10-09 16:40:35 +02:00
  • 4e10afb5a9 scripts : sync amx Georgi Gerganov 2024-10-31 22:13:24 +02:00
  • aa037a60f3 ggml : alloc ggml_contexts on the heap (#2525) Georgi Gerganov 2024-10-31 22:00:09 +02:00
  • 19dca2bb14 ci : fix openblas build (#2511) Georgi Gerganov 2024-10-30 12:58:26 +02:00
  • 55e422109b scripts : add turbo-q8_0 to the benchmark Georgi Gerganov 2024-10-29 19:37:24 +02:00
  • 3f020fac9d whisper : minor compile warning Georgi Gerganov 2024-10-29 19:27:52 +02:00
  • 1626b73b03 whisper : move new-segment callback after DTW step (#2515) jettoblack 2024-10-29 02:47:21 -04:00
  • 850f7b19d3 ruby : fix installation test (#2519) KITAITI Makoto 2024-10-29 15:45:37 +09:00
  • d4bc413505 ruby : add more APIs (#2518) KITAITI Makoto 2024-10-29 02:23:23 +09:00
  • fc49ee4479 ruby : support new-segment callback (#2506) KITAITI Makoto 2024-10-28 22:43:27 +09:00
  • c0ea41f6b2 ruby : add Metal support (#2516) KITAITI Makoto 2024-10-28 20:08:09 +09:00
  • 0fbaac9c89 whisper : fix index overflow in token-level timestamp logic (#2505) Josscii 2024-10-23 20:14:03 +08:00
  • a5abfe6a90 readme : update links and make commands (#2489) toboil-features 2024-10-17 13:25:18 +03:00
  • d3f7137cc9 ruby : fix bindings (#2484) KITAITI Makoto 2024-10-17 00:44:04 +09:00
  • f7c99e49b3 readme : add Vulkan notice (#2488) toboil-features 2024-10-16 18:43:26 +03:00
  • 1d5752fa42 make : fix GGML_VULKAN=1 build (#2485) Georgi Gerganov 2024-10-16 18:42:47 +03:00
  • b6049060dd whisper : add dtw preset for large-v3-turbo (#2481) Rotem Dan 2024-10-15 21:00:21 +03:00
  • 06a1da9daf convert : handle max_target_positions (#2477) CrispStrobe 2024-10-14 09:46:33 +02:00
  • 746d173592 readme : update the Quick Start section (#2475) Salman Faroz 2024-10-14 13:14:57 +05:30
  • fdbfb460ed whisper : add OpenVINO init with state (#2464) Sandro Hanea 2024-10-08 19:08:00 +02:00
  • ebca09a3d1 release : v1.7.1 Georgi Gerganov 2024-10-07 13:06:48 +03:00
  • 9f346d0084 vulkan : retry allocation with fallback flags (#2451) SRHMorris 2024-10-06 08:34:20 +01:00
  • 6a94163b91 release : v1.7.0 Georgi Gerganov 2024-10-05 16:43:26 +03:00
  • 8a35b58c4f scripts : bench v3-turbo Georgi Gerganov 2024-10-05 16:22:53 +03:00
  • 1789abca84 whisper : remove mel leftover constants (396089f) Georgi Gerganov 2024-10-05 16:13:03 +03:00
  • 847f94fdeb whisper : zero-out the KV cache upon clear (#2445) Georgi Gerganov 2024-10-05 15:22:17 +03:00
  • 6e40108a59 objc : fix build Georgi Gerganov 2024-10-05 15:18:50 +03:00
  • 1ba185f4af metal : zero-init buffer contexts (#0) Georgi Gerganov 2024-10-05 14:33:54 +03:00
  • 396089f3cf whisper : revert mel-related changes (#0) Georgi Gerganov 2024-10-05 14:29:45 +03:00
  • 941912467d whisper : adapt to latest ggml (skip) (#0) Georgi Gerganov 2024-10-05 13:14:03 +03:00
  • 0b1b094a67 ggml : fix typo in example usage ggml_gallocr_new (ggml/984) Daniel Bevenius 2024-10-04 15:46:18 +02:00
  • 40e52a76b9 ggml : fixes after sync (ggml/983) Diego Devesa 2024-10-04 08:41:40 +02:00
  • cf977670e6 ggml-backend : add device and backend reg interfaces (llama/9707) Diego Devesa 2024-10-03 21:25:11 +03:00
  • df2c364de7 Fixed dequant precision issues in Q4_1 and Q5_1 (llama/9711) Ouadie EL FAROUKI 2024-10-03 07:50:44 +01:00
  • 1acfadb721 ggml-backend : add device and backend reg interfaces (llama/9707) Diego Devesa 2024-10-03 01:49:47 +02:00
  • ea642144d2 Initial cmake support of SYCL for AMD GPUs (llama/9658) Alberto Cabrera Pérez 2024-10-02 13:57:18 +01:00
  • 282a8654c4 vulkan : do not use tensor->extra (llama/9407) Radoslav Gerganov 2024-10-02 13:49:16 +03:00
  • 936cf3beb7 ggml/ex: calculate accuracy in graph, adapt MNIST (ggml/980) Johannes Gäßler 2024-10-03 17:29:59 +02:00
  • bc92c2f8f0 ggml: refactor cross entropy loss CPU impl. (ggml/976) Johannes Gäßler 2024-10-02 15:32:39 +02:00
  • f7d55e0614 scripts : sync ggml-backend.cpp Georgi Gerganov 2024-10-05 13:09:36 +03:00
  • f62a546e03 whisper : fix excessive memory usage (#2443) Georgi Gerganov 2024-10-05 12:36:40 +03:00
  • 2944cb72d9 examples : update dr_wav.h to newer version (#2449) Rahul Vadhyar 2024-10-04 13:34:51 +05:30
  • ccc2547210 talk-llama : sync llama.cpp Georgi Gerganov 2024-10-02 15:14:46 +03:00
  • 162a455402 metal : reduce command encoding overhead (llama/9698) Georgi Gerganov 2024-10-02 15:12:16 +03:00
  • ff2cb0811f sync : ggml Georgi Gerganov 2024-10-02 15:11:43 +03:00
  • 5e9d6baa48 test: fix OPT_STEP_ADAMW for test-backend-ops (ggml/974) Johannes Gäßler 2024-09-30 09:55:23 +02:00
  • 845f8d663e vulkan : mul_mat: fix UB with small warps (ggml/952) Salvatore Mesoraca 2024-09-30 09:14:09 +02:00
  • 31fdf05fda ggml : fix ggml_cast (ggml/973) Borislav Stanimirov 2024-09-30 10:11:41 +03:00
  • 0ac6666cd2 ggml: fix gradient allocation logic (ggml/966) Johannes Gäßler 2024-09-29 23:18:02 +02:00
  • 6c91da80b8 ggml : define missing HWCAP flags (llama/9684) Georgi Gerganov 2024-09-29 21:18:23 +03:00
  • c245168ba3 ggml : add run-time detection of neon, i8mm and sve (llama/9331) Dan Johansson 2024-09-28 14:06:16 +02:00
  • 280fee8fa0 Enable use to the rebar feature to upload buffers to the device. (llama/9251) Markus Tavenrath 2024-09-28 12:05:05 +02:00
  • 78b4c1c25f mtgpu: enable VMM (llama/9597) R0CKSTAR 2024-09-26 09:27:40 +08:00
  • 1edea2eb4b ggml : remove assert for AArch64 GEMV and GEMM Q4 kernels (llama/9217) Charles Xu 2024-09-25 15:12:20 +02:00
  • 96808786b7 cann: fix crash when llama-bench is running on multiple cann devices (llama/9627) Dou Xinpeng 2024-09-25 11:30:38 +08:00
  • bb57ecb85e CUDA: remove bad assert (ggml/972) Johannes Gäßler 2024-09-29 19:56:17 +02:00
  • abdb73c7cc vulkan : multithread pipeline creation (ggml/963) Jeff Bolz 2024-09-29 11:50:17 -05:00
  • 391e548a43 vulkan : fix build for GGML_VULKAN_RUN_TESTS, add TFLOPS to log (ggml/961) Jeff Bolz 2024-09-27 02:58:01 -05:00