Commit Graph

  • 9bf7250bf9 llama : simplify Mamba with advanced batch splits (llama/8526) compilade 2024-08-21 17:58:11 -04:00
  • 17e49d3ab2 fallback mmvq (llama/9088) Meng, Hengyu 2024-08-20 23:50:17 +08:00
  • 58b725282a Fix SYCL im2col and convert Overflow with Large Dims (llama/9052) zhentaoyu 2024-08-20 23:06:51 +08:00
  • 7e59afa1e0 rpc : print error message when failed to connect endpoint (llama/9042) Radoslav Gerganov 2024-08-19 10:11:45 +03:00
  • 5ac022140e rpc : prevent crashes on invalid input (llama/9040) Radoslav Gerganov 2024-08-19 10:10:21 +03:00
  • 0eaa67280c ggml : dynamic ggml_sched_max_splits based on graph_size (llama/9047) Nico Bosshard 2024-08-16 04:22:55 +02:00
  • 5a62fdb735 cmake : remove unused option GGML_CURL (llama/9011) Georgi Gerganov 2024-08-14 09:14:49 +03:00
  • 60098d6204 ggml : move rope type enum to ggml.h (llama/8949) Daniel Bevenius 2024-08-13 21:13:15 +02:00
  • 317293e6a7 ggml: fix div-by-zero (llama/9003) DavidKorczynski 2024-08-12 13:21:41 +01:00
  • 488a966c07 Optimize Vulkan backend for better CPU performance and less GPU synchronization overhead. (llama/8943) Markus Tavenrath 2024-08-11 10:09:09 +02:00
  • 8954769aa2 feat: ref. cross entropy, add CUDA, fix grad test (ggml/929) Johannes Gäßler 2024-08-27 20:39:30 +02:00
  • df06468d9e ggml: remove bad assert (ggml/928) Johannes Gäßler 2024-08-24 19:27:02 +02:00
  • 1fbd828a5d examples: add MNIST training + missing ops Johannes Gäßler 2024-07-30 15:56:35 +02:00
  • d2986f8b07 models : add support for wget2 for fedora (#2387) Brad Murray 2024-08-28 04:46:01 -04:00
  • 8bfa8574e2 readme : update the path to bench.py (#2386) Peng 2024-08-28 16:45:05 +08:00
  • 376567bf4f readme : fix typo (#2383) Ivo von Putzer Reibegg 2024-08-28 10:42:18 +02:00
  • c0fd64a9c0 readme : fix broken links in implementation details section (#2382) stormofice 2024-08-28 10:41:51 +02:00
  • 6e9596f6de whisper : fix compile warning for unused params Georgi Gerganov 2024-08-28 11:40:11 +03:00
  • 9e3c5345cd sync : ggml vulkan (ggml/0) Georgi Gerganov 2024-08-20 11:27:12 +03:00
  • b6c05ce82f yolo : add backend support (ggml/924) Radoslav Gerganov 2024-08-19 10:09:33 +03:00
  • 52c80cac00 ggml : fix typo in ggml-quants.c comment (ggml/922) Daniel Bevenius 2024-08-15 09:42:38 +02:00
  • 3643120690 feat: add new sin and cos operators (ggml/919) Ronsor 2024-08-12 06:02:08 -07:00
  • d65786ea54 readme : fix broken links (#2358) Eric Curtin 2024-08-20 03:57:45 -04:00
  • 7f78675008 examples : use colorblind friendly TTY color scheme (#2360) Justine Tunney 2024-08-20 00:49:10 -07:00
  • 22fcd5fd11 sync : ggml Georgi Gerganov 2024-08-12 11:59:15 +03:00
  • 993f0df419 ggml : support forward pass broadcasting in ggml_sub (ggml/914) Salvatore Mesoraca 2024-08-11 10:08:53 +02:00
  • 9b1788483c metal : fix uninitialized abort_callback (llama/8968) slaren 2024-08-10 15:42:10 +02:00
  • ad37d26983 rpc : sanitize tensor data + warnings (llama/0) Georgi Gerganov 2024-08-09 23:03:21 +03:00
  • 81c999fe0a cann : add Ascend NPU support (#2336) Mengqing Cao 2024-08-09 20:21:56 +08:00
  • 4b7de08bfd whisper : fix compile warning (#0) Georgi Gerganov 2024-08-08 22:59:59 +03:00
  • 4b9c4de1ad sync : ggml Georgi Gerganov 2024-08-08 22:59:19 +03:00
  • be88ee1d75 ggml : add CANN backend (llama/0) hipudding 2024-08-08 14:48:06 +03:00
  • 3ab19c744e scripts : sync cann Georgi Gerganov 2024-08-08 22:58:13 +03:00
  • 6eac06759b ci : disable ruby workflow (#0) Georgi Gerganov 2024-08-08 20:35:21 +03:00
  • 2e9a5bd2c4 ci : try to fix FreeBSD (#0) Georgi Gerganov 2024-08-08 20:32:19 +03:00
  • 58323bf8ed build : fix aarch64 (#0) Georgi Gerganov 2024-08-08 14:27:16 +03:00
  • 22058f2dbc talk-llama : sync llama.cpp Georgi Gerganov 2024-08-08 14:16:50 +03:00
  • 5b7979a1e6 sync : ggml Georgi Gerganov 2024-08-08 14:10:06 +03:00
  • ee14c02365 ggml-backend : fix async copy from CPU (llama/8897) slaren 2024-08-07 13:29:02 +02:00
  • ab39dd34e1 Updated SYCL device filtering (llama/8901) Ouadie EL FAROUKI 2024-08-07 11:25:36 +01:00
  • b1348d3530 CUDA/HIP: fix tests/test-backend-ops (llama/8896) Johannes Gäßler 2024-08-07 09:07:52 +02:00
  • 90641b5cf4 CUDA: fix padding logic for FP16/FP32 (llama/8884) Johannes Gäßler 2024-08-06 17:13:55 +02:00
  • 4160b930f1 ggml : add epsilon as a parameter for group_norm (llama/8818) Molly Sophia 2024-08-06 15:26:46 +08:00
  • 7a96e661e4 ggml : fix overflows in elu function (llama/8866) Justine Tunney 2024-08-05 05:43:40 -07:00
  • a902fb4ab2 ggml : reading the runtime sve config of the cpu (llama/8709) jdomke 2024-08-04 01:34:41 +09:00
  • 6cb38c3673 Fix conversion of unnormalized BF16->BF16 weights (llama/7843) Sigbjørn Skjæret 2024-08-02 21:11:39 +02:00
  • 9cf14ebcbc Fixing wrong VDR iq4nl value (llama/8812) Ouadie EL FAROUKI 2024-08-02 01:55:17 +01:00
  • 8e39ee171f ggml-cuda: Adding support for unified memory (llama/8035) matteo 2024-08-01 23:28:28 +02:00
  • d26250f78c Build: Only include execinfo.h on linux systems that support it (llama/8783) Alex O'Connell 2024-08-01 12:53:46 -04:00
  • 5218ea21b8 cuda : fix dmmv cols requirement to 2*GGML_CUDA_DMMV_X (llama/8800) slaren 2024-08-01 15:26:22 +02:00
  • e60be821ce added android implementation of ggml_print_backtrace_symbols (llama/8751) l3utterfly 2024-07-30 23:40:18 +09:00
  • 19708df884 cann: update cmake (llama/8765) wangshuai09 2024-07-30 18:37:35 +08:00
  • 3f190addda Add TIMESTEP_EMBEDDING OP (llama/8707) zhentaoyu 2024-07-30 14:56:51 +08:00
  • b355ee7cfa ggml: bugfix: fix the inactive elements is agnostic for risc-v vector (llama/8748) CarterLi999 2024-07-30 00:38:34 +08:00
  • 49ac8872b4 cuda : organize vendor-specific headers into vendors directory (llama/8746) R0CKSTAR 2024-07-29 20:56:12 +08:00
  • 8ef98ae7e3 add conv support (llama/8688) Meng, Hengyu 2024-07-29 10:50:27 +08:00
  • e471adcfa5 feat: Support Moore Threads GPU (llama/8383) R0CKSTAR 2024-07-28 07:41:25 +08:00
  • aa816c922c ggml : ignore more msvc warnings (ggml/906) Borislav Stanimirov 2024-08-07 10:00:56 +03:00
  • b3264eb266 metal : fix struct name (ggml/912) Georgi Gerganov 2024-08-07 09:57:00 +03:00
  • eb2eb87a58 metal : add abort callback (ggml/905) Conrad Kramer 2024-08-07 02:55:49 -04:00
  • 83fcb0e486 vulkan : implement Stable Diffusion operators (ggml/904) 0cc4m 2024-08-04 17:28:08 +02:00
  • f7bb412878 ggml : move c parameter comment to ggml_rope_ext (ggml/901) Daniel Bevenius 2024-07-29 15:06:06 +02:00
  • ef6dcf0d0c ggml : resolve sync conflicst (ggml/0) Georgi Gerganov 2024-07-27 17:17:23 +03:00
  • c7ea4fd235 common : handle new quant types (ggml/0) Georgi Gerganov 2024-07-27 17:17:04 +03:00
  • 525f190917 ggml : add ggml-aarch64 (ggml/0) Dibakar Gope 2024-07-27 17:16:40 +03:00
  • dd916a2852 ggml : reduce hash table reset cost (llama/8698) slaren 2024-07-27 04:41:55 +02:00
  • 0620fe00ec ggml: handle ggml_init failure to fix NULL pointer deref (llama/8692) DavidKorczynski 2024-07-25 22:23:05 +01:00
  • 31d0a9a14f fix multi-gpu issue on sycl (llama/8554) Chen Xi 2024-07-25 11:45:18 +00:00
  • c06970dd72 ggml : add and use ggml_cpu_has_llamafile() (llama/8664) Georgi Gerganov 2024-07-25 12:37:42 +03:00
  • 7598acf525 Re-add erroneously removed -fsycl from GGML_EXTRA_LIBS (llama/8667) Joe Todd 2024-07-24 11:55:26 +01:00
  • 43ddfce969 sycl : Add support for non-release DPC++ & oneMKL (llama/8644) Joe Todd 2024-07-23 14:58:37 +01:00
  • a7e6d2cd9c Vulkan IQ4_NL Support (llama/8613) 0cc4m 2024-07-23 10:56:49 +02:00
  • 86506b0c5c Allow all RDNA2 archs to use sdot4 intrinsic (llama/8629) Jeroen Mostert 2024-07-23 10:50:40 +02:00
  • 11182fae34 fix scratch size of softmax (llama/8642) luoyu-intel 2024-07-23 07:43:28 +00:00
  • 0bc8bffe1d ggml: fix compile error for RISC-V (llama/8623) Mark Zhuang 2024-07-22 15:56:45 +08:00
  • 8c4f30497a CUDA: MMQ code deduplication + iquant support (llama/8495) Johannes Gäßler 2024-07-20 22:25:26 +02:00
  • b1ee3a8444 gguf : handle null name during init (llama/8587) Georgi Gerganov 2024-07-20 17:15:42 +03:00
  • be9a16fd3f ggml : fix quant dot product with odd number of blocks (llama/8549) slaren 2024-07-19 17:17:27 +02:00
  • f4d9a95b0f ggml : add friendlier error message to fopen errors (llama/8575) Clint Herron 2024-07-19 07:05:45 -04:00
  • a8ab3abe09 CUDA: fix partial offloading for ne0 % 256 != 0 (llama/8572) Johannes Gäßler 2024-07-18 23:48:47 +02:00
  • fb6a835938 cmake : install all ggml public headers (llama/8480) 65a 2024-07-18 07:47:12 -07:00
  • 8923bb4292 Add Ascend NPU backend (llama/6035) hipudding 2024-07-17 19:23:50 +08:00
  • fcba6aa352 make/cmake: add missing force MMQ/cuBLAS for HIP (llama/8515) Johannes Gäßler 2024-07-16 21:20:59 +02:00
  • 8807fe608b Refactor lora adapter support (llama/8332) Xuan Son Nguyen 2024-07-15 20:50:47 +02:00
  • 3e94c7a81d add concat through dim 1/2 (llama/8483) Meng, Hengyu 2024-07-15 19:32:15 +08:00
  • 77af3254e1 Vulkan MMQ Fix (llama/8479) 0cc4m 2024-07-15 09:38:52 +02:00
  • d4b3cffec4 vulkan : cmake integration (llama/8119) bandoti 2024-07-13 13:12:39 -03:00
  • b852a4c5ca metal : template-ify some of the kernels (llama/8447) Georgi Gerganov 2024-07-13 18:32:33 +03:00
  • 2157abaab4 ggml : minor naming changes (llama/8433) Georgi Gerganov 2024-07-12 10:46:02 +03:00
  • 68d609a12c fix the mul_mat_id ut issues (llama/8427) Chen Xi 2024-07-12 00:52:04 +00:00
  • 5a8ae474f0 ggml : add NVPL BLAS support (ggml/8329) (llama/8425) Nicholai Tukanov 2024-07-11 11:49:15 -05:00
  • 84493d7f3e cuda : suppress 'noreturn' warn in no_device_code (llama/8414) Daniel Bevenius 2024-07-11 17:53:42 +02:00
  • 15d71189e9 CUDA: optimize and refactor MMQ (llama/8416) Johannes Gäßler 2024-07-11 16:47:47 +02:00
  • 37e962580f Use multi_ptr to clean up deprecated warnings (llama/8256) AidanBeltonS 2024-07-10 16:10:49 +01:00
  • db0ea7a2f2 ggml : move sgemm sources to llamafile subfolder (llama/8394) Georgi Gerganov 2024-07-10 15:23:29 +03:00
  • 5498b0e6c0 ggml : add AArch64 optimized GEMV and GEMM Q4 kernels (llama/5780) Dibakar Gope 2024-07-10 07:14:51 -05:00
  • 2af4a52c39 sycl : Reenabled mmvq path for the SYCL Nvidia Backend (llama/8372) Alberto Cabrera Pérez 2024-07-09 15:03:15 +01:00
  • eee2fe882e sycl : fix powf call in device code (llama/8368) Alberto Cabrera Pérez 2024-07-08 14:22:41 +01:00
  • 0d1a11e5e2 ggml : loop tiling optimizations for scalar path (ggml/898) Mahesh Madhav 2024-07-25 00:54:08 -07:00
  • b2ead7d6f4 ggml: add support for float16 input tensors in pooling operations (ggml/895) Ivan Filipov 2024-07-22 14:32:02 +03:00