Commit Graph

  • b6bbce4ae9 cmake : fix json INTERFACE library (#2069) Xingchen Song(宋星辰) 2024-05-13 19:29:39 +08:00
  • 7705dc52da main : fix double quote escaping in csv output (#2090) mashizora 2024-05-13 16:55:32 +08:00
  • e6acaf9d91 metal : tune soft_max number of threads (#0) Georgi Gerganov 2024-05-13 11:01:07 +03:00
  • 2c81e6fd51 whisper : remove old flash attn code (#0) Georgi Gerganov 2024-05-13 10:41:33 +03:00
  • 9506267ce5 ggml : try fix ppc64 (#0) Georgi Gerganov 2024-05-12 20:36:31 +03:00
  • fbeb80b5f0 ggml : remove oboslete alibi code (skipme) (#0) Georgi Gerganov 2024-05-12 20:55:57 +03:00
  • 3fa7d29876 talk-llama : sync llama.cpp Georgi Gerganov 2024-05-12 20:12:46 +03:00
  • fe179ae0cc sync : ggml Georgi Gerganov 2024-05-12 19:23:22 +03:00
  • 40aeeeecc4 ggml : optimize for ppc64le using VSX intrinsics (ggml/784) Hong Bo PENG 2024-05-12 17:17:18 +08:00
  • 5a863fbe18 metal : fix indent (ggml/0) Georgi Gerganov 2024-05-11 16:57:53 +03:00
  • 91c646c61d ggml : restore sigmoid decl order (ggml/0) Georgi Gerganov 2024-05-11 16:50:54 +03:00
  • accada542a ggml : resolve merge (ggml/0) Georgi Gerganov 2024-05-11 16:25:50 +03:00
  • e54329da7b ggml : full ALiBi support (llama/7192) Georgi Gerganov 2024-05-11 10:32:41 +03:00
  • 284fac39fb metal : fix flash attention kernel requirements (llama/7169) Georgi Gerganov 2024-05-10 18:20:10 +03:00
  • fe454b8d9e Minor arithmetic improvement to mmvq wrapper kernel (llama/7172) Ouadie EL FAROUKI 2024-05-10 01:32:15 +01:00
  • c114b75aee Vulkan Bugfixes and Improvements (llama/7084) 0cc4m 2024-05-09 20:39:54 +02:00
  • 4be936b88b CUDA: generalize FP16 fattn vec kernel (llama/7061) Johannes Gäßler 2024-05-09 14:32:02 +02:00
  • 26c550f772 opencl : alignment size converted from bits to bytes (llama/7090) Albert Jin 2024-05-09 17:34:37 +08:00
  • 24f0aa460b Introduction of CUDA Graphs to LLama.cpp (llama/6766) agray3 2024-05-08 21:55:49 +01:00
  • 69efc39d5c metal : use vm_allocate instead of posix_memalign on macOS (llama/7078) Gilad S 2024-05-08 22:08:10 +03:00
  • a2ad810118 ggml : introduce bfloat16 support (llama/6412) Justine Tunney 2024-05-08 02:30:09 -04:00
  • 1ae1a9cd56 metal : fix unused warning Georgi Gerganov 2024-05-08 09:14:50 +03:00
  • b5521fea19 Add an option to build without CUDA VMM (llama/7067) William Tambellini 2024-05-06 11:12:14 -07:00
  • 9b84195225 gguf-split: add --no-tensor-first-split (llama/7072) Xuan Son Nguyen 2024-05-04 18:56:22 +02:00
  • 11c1df0436 CUDA: CUDART < 11.7 workaround for __hmax, __hmax2 (llama/7019) Johannes Gäßler 2024-05-01 14:46:37 +02:00
  • c754494fdd switch to using localizedDescription (llama/7010) Kevin Gibbons 2024-04-30 08:14:02 -07:00
  • 1bce67999d metal : remove deprecated error code (llama/7008) Georgi Gerganov 2024-04-30 15:52:21 +03:00
  • 6c39ea46b6 metal : log more info on error (llama/6987) Kevin Gibbons 2024-04-30 02:34:50 -07:00
  • 156a33a990 ggml : add Flash Attention (llama/5021) Georgi Gerganov 2024-04-30 12:16:08 +03:00
  • 5167ebdfca ggml : fix __MSC_VER -> _MSC_VER (llama/6977) Georgi Gerganov 2024-04-29 17:55:02 +03:00
  • b574646d75 Fix more int overflow during quant (PPL/CUDA). (llama/6563) DAN™ 2024-04-28 18:38:44 -04:00
  • 388c3462a6 gguf : enforce that tensor names are unique (llama/6905) Xuan Son Nguyen 2024-04-28 17:36:18 +02:00
  • 9ad202bee9 add device version in device list (llama/6959) Neo Zhang 2024-04-28 22:40:31 +08:00
  • f0d3fb4a7e Reset schedule earlier to allow overlap with ggml graph computation on device (llama/6933) agray3 2024-04-26 19:08:30 +01:00
  • 9d4c8b8aa5 add basic tensor data validation function (llama/6884) slaren 2024-04-26 18:39:58 +02:00
  • ecfac1e240 gguf : fix mismatch between alloc and free functions (llama/6929) slaren 2024-04-26 17:07:42 +02:00
  • 6f7140f568 Merge pull request from GHSA-p5mv-gjc5-mwqv Georgi Gerganov 2024-04-26 10:41:53 +03:00
  • 05b17112cf ggml : fix redefinition of vaddvq_f32 for 32-bit ARM (llama/6906) Georgi Gerganov 2024-04-25 15:48:25 +03:00
  • a15fb5cd79 ggml : fix MIN / MAX macros (llama/6904) Georgi Gerganov 2024-04-25 15:12:28 +03:00
  • 63fd148d8f ggml : move 32-bit arm compat in ggml-impl.h (llama/6865) Georgi Gerganov 2024-04-24 12:00:07 +03:00
  • 6c3971b29b llamafile : improve sgemm.cpp (llama/6796) Justine Tunney 2024-04-22 15:00:36 -04:00
  • a6d264f331 ggml : fix calloc argument ordering. (llama/6820) Dave Airlie 2024-04-23 00:05:06 +10:00
  • 2959686019 ggml : fix ggml_backend_cpu_supports_op() for CPY (llama/0) Georgi Gerganov 2024-04-21 16:47:57 +03:00
  • c96b0a938e ggml : group all experts in a single ggml_mul_mat_id (llama/6505) slaren 2024-04-18 15:18:48 +02:00
  • c97796aa0f ggml : fix llamafile sgemm wdata offsets (llama/6710) Georgi Gerganov 2024-04-16 23:50:22 +03:00
  • 7a4f7d825e ggml : add llamafile sgemm (llama/6414) Justine Tunney 2024-04-16 14:55:30 -04:00
  • fdb2c87350 llama : add qwen2moe (llama/6074) Shijie 2024-04-16 23:40:48 +08:00
  • 98c0b77e0c fix mul_mat_id() for new input, make the ut pass (llama/6682) Neo Zhang Jianyu 2024-04-15 17:12:26 +08:00
  • 9d6d50d933 Added support for GGML_OP_CLAMP in Metal (llama/6662) Dave 2024-04-14 07:14:19 -04:00
  • c1320c1f0c fix memcpy() crash, add missed cmd in guide, fix softmax (llama/6622) Neo Zhang Jianyu 2024-04-14 10:42:29 +08:00
  • 66aaf03a7a CUDA: fix matrix multiplication logic for tests (llama/6667) Johannes Gäßler 2024-04-14 00:21:55 +02:00
  • 00a0947c65 metal : unify mul_mv_id kernels (llama/6556) slaren 2024-04-12 18:13:20 +02:00
  • 60f3713026 llama : add gguf_remove_key + remove split meta during quantize (llama/6591) jiez 2024-04-12 18:45:06 +08:00
  • 37e6757453 feat: implemented sigmoid function (ggml/806) Justina Cho 2024-05-01 14:44:26 -07:00
  • 8dcefdf4a9 build: fix and ignore msvc warnings (ggml/805) Borislav Stanimirov 2024-04-25 17:24:07 +03:00
  • 73d13ad19a ggml : expose SSE3 and SSSE3 for MSVC when AVX is available (#2128) Przemysław Pawełczyk 2024-05-08 17:33:43 +02:00
  • b6680fab50 build : improve disabling AVX-512 (#2129) Przemysław Pawełczyk 2024-05-08 17:32:43 +02:00
  • f760756078 minor: add CMakeSettings.json to gitignore (#2094) Borislav Stanimirov 2024-05-08 11:03:21 +03:00
  • 58210d6a76 examples : fix node compilation (#2115) Pedro Probst 2024-05-02 18:52:55 -03:00
  • 8fac6455ff make : change GNU make default CXX from g++ to c++ (#2100) Przemysław Pawełczyk 2024-04-28 23:54:21 +02:00
  • 22b6598cc9 Remove unnecessary memory reallocation in fft (#2080) goldwaving 2024-04-28 15:06:12 -02:30
  • 858452d58d models : disable old script (#2079) Georgi Gerganov 2024-04-24 14:56:30 +03:00
  • 7f85e1d7fd whisper : more prominent log message for sub-1s audio (#2065) Georgi Gerganov 2024-04-24 14:45:27 +03:00
  • b0c3cbf2e8 main : pass nullptr when regex is empty (#2070) Georgi Gerganov 2024-04-17 12:23:47 +03:00
  • a750868428 readme : add up-to-date repository for Python bindings (#2063) AIWintermuteAI 2024-04-16 19:15:52 +08:00
  • 7395c70a74 release : v1.5.5 Georgi Gerganov 2024-04-16 14:08:31 +03:00
  • 9fab28135c server : add dtw (#2044) Emmanuel Schmidbauer 2024-04-15 15:16:58 -04:00
  • 08d3eef97d build : fix embedded Metal library generation (#2045) Didzis Gosko 2024-04-15 20:23:05 +03:00
  • 1b5439a6c2 node : support no timestamps (#2048) Pedro Probst 2024-04-15 14:03:34 -03:00
  • c7f95b7ca2 build : detect AVX512 in Makefile, add AVX512 option in CMake (#2043) Didzis Gosko 2024-04-15 20:02:09 +03:00
  • 5c554c04ff whisper.nvim : fix missing reference to "model" variable (#2049) Kendrick Taylor 2024-04-15 09:41:28 -07:00
  • c383f091a1 whisper : update grammar-parser.cpp (#2058) Ikko Eltociear Ashimine 2024-04-16 01:40:27 +09:00
  • 8f253ef3af sync : ggml Georgi Gerganov 2024-04-09 20:27:55 +03:00
  • c7dc37f97c license : update copyright notice + add AUTHORS Georgi Gerganov 2024-04-09 20:27:44 +03:00
  • 526332873b llama : add Command R Plus support (llama/6491) Carolinabanana 2024-04-09 09:16:13 +01:00
  • 1d2721ca72 remove row=1 cond (llama/6532) Abhilash Majumder 2024-04-08 13:56:01 +05:30
  • 219e601dab support/fix OPs GGML_TYPE_IQ4_NL, GGML_TYPE_IQ4_XS, GGML_TYPE_IQ3_XXS, GGML_TYPE_IQ3_S, GGML_TYPE_IQ2_XXS, GGML_TYPE_IQ2_XS, GGML_TYPE_IQ2_S, GGML_TYPE_IQ1_S, GGML_TYPE_IQ1_M (llama/6521) Neo Zhang Jianyu 2024-04-07 10:55:59 +08:00
  • 3b8aade3c2 scripts : update sync Georgi Gerganov 2024-04-09 20:25:50 +03:00
  • 52ccd4a3a8 files : rename ./extra to ./scripts Georgi Gerganov 2024-04-09 20:12:17 +03:00
  • 5275074d37 whisper : fix DTW memory access (#2012) Brad Murray 2024-04-09 11:38:19 -04:00
  • c15b4cda7d common : fix file-handle leak in read_wav() (#2026) ulatekh 2024-04-09 08:34:34 -07:00
  • d3cfb6ca2b main : set stdin to binary mode on Windows (#2025) Rotem Dan 2024-04-09 18:33:32 +03:00
  • 956ef860bc cmake : support for CPU BLAS build via Intel MKL (#2024) slashlib 2024-04-09 18:32:46 +03:00
  • 671b4bde6c main : allow a response-file as the sole parameter (#2019) ulatekh 2024-04-09 08:31:16 -07:00
  • c8eeb93a6a whisper : suppress tokens with a regex (#1997) ulatekh 2024-04-09 08:27:28 -07:00
  • 319fe5146e cmake : create solution folders (#2004) ulatekh 2024-04-09 08:23:33 -07:00
  • 13c22321d1 sync : ggml Georgi Gerganov 2024-04-07 17:04:56 +03:00
  • ccbe9d5676 extra : sync grammar-parser Georgi Gerganov 2024-04-07 17:04:22 +03:00
  • 81a3c41aa0 talk-llama : sync llama.cpp Georgi Gerganov 2024-04-07 16:21:08 +03:00
  • a50207c65d sync : ggml Georgi Gerganov 2024-04-07 16:18:11 +03:00
  • 97878e53fd sync : llama.cpp (skip) Georgi Gerganov 2024-04-06 17:50:21 +03:00
  • 61b05815e0 Fixed minor bug when enabling FP16 for non intel targets (llama/6464) Ouadie EL FAROUKI 2024-04-05 14:35:06 +01:00
  • 1dce94cf26 ggml : mul_mat_id use the same tensor for all the experts (llama/6387) slaren 2024-04-03 15:07:05 +02:00
  • f12e982c0b Disable iqx on windows as WA (llama/6435) Meng, Hengyu 2024-04-03 10:34:40 +08:00
  • fa966b9b40 Vulkan k-quant mmq and ggml-backend offload functionality (llama/6155) 0cc4m 2024-03-29 17:29:21 +01:00
  • b83a9fc9d3 fix set main gpu crash (llama/6339) Neo Zhang Jianyu 2024-03-28 08:55:24 +08:00
  • 3adbf2fb03 ggml : fix bounds checking of zero size views (llama/6347) slaren 2024-03-27 15:07:50 +01:00
  • 700d146127 backend : fix typo in scheduler documentation (ggml/781) Daniel Bevenius 2024-04-03 22:57:20 +02:00
  • a74fde9b4c extra : sync ggml-cuda folder Georgi Gerganov 2024-04-07 16:10:44 +03:00
  • 1d7657f409 ggml: bypass code incompatible with CUDA < 11.1 (#2020) Slava Primenko 2024-04-04 14:49:24 +02:00