Commit Graph

  • 66d8f0b7f1 ggml : fix q2_k bpw in comments (ggml/680) Georgi Gerganov 2024-01-05 15:36:04 +02:00
  • ba5bcde874 coreml : fix ANE optimized encoder (#1716) Yajing Tang 2024-01-04 06:28:30 -08:00
  • ab0a8593c5 whisper.swiftui : add .gitignore Georgi Gerganov 2024-01-04 14:47:42 +02:00
  • 668ffc9b23 whispser : reset the "batched" timings (#1721) Georgi Gerganov 2024-01-04 13:37:25 +02:00
  • 9962371f71 release : v1.5.3 Georgi Gerganov 2024-01-03 19:36:33 +02:00
  • 993acb5d41 swift : update Package.swift to use ggml as package dependency (#1701) Ashraful Islam 2024-01-03 11:30:26 -06:00
  • a3d0aa73d1 ggml : add error handling to graph_compute (#1714) Finn Voorhees 2024-01-03 08:39:43 -05:00
  • 14c57952f7 cuda : simplify expression Georgi Gerganov 2024-01-03 14:18:46 +02:00
  • 6c369d6788 cuda : mark I16 and I32 ops as unsupported Georgi Gerganov 2024-01-03 13:01:44 +02:00
  • 4cdd9aad9b metal : add kernel_get_rows_i32 Georgi Gerganov 2024-01-03 11:35:46 +02:00
  • f38c057503 metal : optimize ggml_mul_mat_id (faster Mixtral PP) (llama/4725) Georgi Gerganov 2024-01-02 21:07:47 +02:00
  • 1e5544b39b metal : enable shader debugging (cmake option) (llama/4705) Georgi Gerganov 2024-01-02 10:57:44 +02:00
  • d5673af79f ggml : add ggml_vdotq_s32 alias (llama/4715) Georgi Gerganov 2023-12-31 11:43:31 +02:00
  • a28dacec65 CUDA: fixed tensor cores not being used on RDNA3 (llama/4697) Johannes Gäßler 2023-12-30 13:52:01 +01:00
  • dbe29d4e33 ggml : add ggml_cpu_has_avx_vnni() (llama/4589) automaticcat 2023-12-30 15:07:48 +07:00
  • fe3a67c546 CUDA: fix tensor core logic for Pascal and HIP (llama/4682) Johannes Gäßler 2023-12-29 23:12:53 +01:00
  • b138ff2be3 cuda: fix vmm oom issue on NVIDIA AGX Orin (llama/4687) hydai 2023-12-30 00:31:19 +08:00
  • cf6f1e4181 ggml : extend ggml_get_rows, ggml_repeat, ggml_concat (ggml/639) Guillaume Wenzek 2023-12-29 18:07:03 +01:00
  • 620a223814 scripts : fix sync order + metal sed Georgi Gerganov 2024-01-03 11:42:42 +02:00
  • f39f9690ec examples : fix WASM Stack Overflow (#1713) Andreu Huguet 2024-01-02 17:50:04 +01:00
  • f9ca90256b docker : fix the publishing of the CUDA Docker image (#1704) bobqianic 2023-12-30 21:12:31 +00:00
  • 2623640cd6 scripts : do not sync commits from this repo Georgi Gerganov 2023-12-29 15:00:46 +02:00
  • d87de61ae6 ci : build with CLBlast + ggml-opencl use GGML_API (#1576) Tamotsu Takahashi 2023-12-29 19:23:27 +09:00
  • f5f485f899 whisper : replace tensor->n_dims with ggml_n_dims(tensor) (#1694) bobqianic 2023-12-29 09:38:35 +00:00
  • e77b27c331 sync : ggml (VMM, sync-ggml-am, dotprod ARM fixes, CUDA fixes) (#1691) Georgi Gerganov 2023-12-29 11:30:47 +02:00
  • a5cc3dc8a2 download : fix large q5 model name (#1695) Dimo 2023-12-29 10:14:32 +01:00
  • 37a709f655 whisper : Replace WHISPER_PRINT_DEBUG with WHISPER_LOG_DEBUG (#1681) bobqianic 2023-12-23 12:02:58 +00:00
  • 3a5302108d sync : ggml (ggml_scale, ggml_row_size, etc.) (#1677) Georgi Gerganov 2023-12-22 17:53:39 +02:00
  • d2ee117a0a docker : Dockerize whisper.cpp (#1674) Chaoqun 2023-12-22 19:16:02 +08:00
  • db8ccdb850 CI : Add coverage for talk-llama when WHISPER_CUBLAS=1 (#1672) bobqianic 2023-12-21 22:39:46 +00:00
  • d2419030b0 examples : Revert CMakeLists.txt for talk-llama (#1669) bobqianic 2023-12-21 20:48:52 +00:00
  • 8986690c2a cmake : set default CUDA architectures (#1667) bobqianic 2023-12-21 13:44:04 +00:00
  • 9286d3f584 bench.py : add different large models (#1655) Alfredo Montesinos 2023-12-19 04:40:14 -06:00
  • 940de9dbe9 wchess : update README.md Georgi Gerganov 2023-12-14 22:00:47 +02:00
  • 88112c8afb release : v1.5.2 Georgi Gerganov 2023-12-14 17:56:11 +02:00
  • 375585c07c wchess : update readme Georgi Gerganov 2023-12-14 17:51:14 +02:00
  • fd99ece8e3 wchess : whisper assisted chess (#1595) fraxy-v 2023-12-14 15:58:26 +02:00
  • 8171e621fc sync : ggml (Metal fixes, new ops, tests) (#1633) Georgi Gerganov 2023-12-13 21:55:03 +02:00
  • ec03661b20 cmake : target windows 8 or above for prefetchVirtualMemory in llama-talk (#1617) Kreijstal 2023-12-12 12:35:00 +01:00
  • 6335933a5b cmake : Fix bug in httplib.h for mingw (#1615) Kreijstal 2023-12-10 18:47:52 +01:00
  • 885b5563d0 metal : fix ggml_metal_log vargs (#1606) Finn Voorhees 2023-12-08 11:50:50 +00:00
  • 9521ba6801 whisper.objc : disable timestamps for real-time transcription Georgi Gerganov 2023-12-08 13:43:37 +02:00
  • 29511d33c7 whisper : more debug messages + fix fallback logic Georgi Gerganov 2023-12-08 13:43:03 +02:00
  • 7bc4d22337 metal : fix soft_max kernel src1 argument (#1602) Georgi Gerganov 2023-12-08 13:39:32 +02:00
  • afce6fa113 sync : ggml (new ops, new backend, etc) (#1602) Georgi Gerganov 2023-12-07 22:27:19 +02:00
  • 3163090d89 server : pass max-len argument to the server (#1574) Oleg Sidorov 2023-12-05 22:01:45 +01:00
  • f0efd0202d ios : Remove #if arch(arm) check for using Metal (#1561) Finn Voorhees 2023-12-05 01:14:26 +00:00
  • 3c28d1a571 ggml : Fix 32-bit compiler warning (#1575) Digipom 2023-12-03 09:15:28 -05:00
  • e369243ebd ggml : re-enable blas for src0 != F32 (#1583) Georgi Gerganov 2023-12-01 23:57:52 +02:00
  • a0ec3fac54 Server : Add support for .vtt format to Whisper server (#1578) Aleksander Andrzejewski 2023-12-01 00:44:26 +01:00
  • 6559b538e5 server : backport .srt output format (#1565) Oleg Sidorov 2023-11-28 14:42:58 +01:00
  • 73d5005880 cmake : install required ggml.h header (#1568) Gregor Jasny 2023-11-28 14:41:49 +01:00
  • 6b094b6dfe server : set default CORS headers to allow all (#1567) Kasumi 2023-11-28 17:55:20 +08:00
  • 641f2f4282 readme : update help (#1560) Hang 2023-11-27 18:04:08 +08:00
  • bfacd9f8ce CI : Add CUDA 11.8.0 support (#1554) bobqianic 2023-11-27 10:03:16 +00:00
  • f52e74d4dc CI : Rectify the Clang-Related workflow issues (#1551) bobqianic 2023-11-27 09:35:37 +00:00
  • 23c21e92eb server : automatically convert audio on the server (#1539) Ismatulla Mansurov 2023-11-27 02:28:34 -07:00
  • 447d49530c whisper : remove trailing whitespaces Georgi Gerganov 2023-11-24 13:13:12 +02:00
  • 9d6ebd877c release : v1.5.1 Georgi Gerganov 2023-11-24 12:41:55 +02:00
  • 0ba365f958 metal : add backend function to check device family support (#1547) Georgi Gerganov 2023-11-24 12:37:08 +02:00
  • 010c8ec3ab cuda : sync some minor stuff from llama.cpp (#1548) Georgi Gerganov 2023-11-24 12:36:21 +02:00
  • ffdb5c4735 whisper : fix typo Georgi Gerganov 2023-11-24 09:45:10 +02:00
  • a5881d619c server : add --print-realtime param (#1541) ecneladis 2023-11-24 08:35:02 +01:00
  • 34f70b3a56 whisper : add whisper_lang_str_full (#1546) bradmit 2023-11-24 18:33:13 +11:00
  • 8328d1900f fix(server): typo in temperature parameter (#1545) Okabintaro 2023-11-23 19:59:36 +01:00
  • d2bd5f0bdc metal : fix build (#1544) sandrohanea 2023-11-23 19:20:53 +01:00
  • 34209a37a2 readme : add server example Georgi Gerganov 2023-11-23 17:20:33 +02:00
  • 180e062eda go : fixed Makefile for MacOS ARM 64 (#1530) Gleicon Moraes 2023-11-22 13:08:11 -03:00
  • 5c7be85fdc Change temp file name for server application (#1535) Felix 2023-11-22 09:23:36 +01:00
  • 146169ec38 bench : pass memcpy threads from cli Georgi Gerganov 2023-11-21 22:27:22 +02:00
  • 9befab5ab9 bench : multi-thread memcpy (#1534) Georgi Gerganov 2023-11-21 22:07:30 +02:00
  • 9ac88f2b57 Close file after writing in server application (#1533) Felix 2023-11-21 20:36:10 +01:00
  • 46f5b6cb08 server : add video to readme Georgi Gerganov 2023-11-21 17:30:43 +02:00
  • eff3570f78 server : add a REST Whisper server example with OAI-like API (#1380) Felix 2023-11-20 20:40:24 +01:00
  • fa19bc4195 whisper : update example in whisper.h (#1529) M. A. Ali 2023-11-20 20:52:27 +02:00
  • a01b2e0971 sdl : fix audio callback (#1523) Georgi Gerganov 2023-11-20 13:16:38 +02:00
  • 8159a9ab99 whisper : reuse whisper_decode_with_state (#1521) Georgi Gerganov 2023-11-20 13:16:11 +02:00
  • 7516d9c16d ci : redistribute CUDA DLLs (#1522) Tamotsu Takahashi 2023-11-19 19:43:22 +09:00
  • 46cc26d1b9 whisper : fix with_state methods to use the correct state (#1519) sandrohanea 2023-11-19 10:25:30 +01:00
  • f784f9fa12 whisper : fix overriding the audio context Georgi Gerganov 2023-11-19 10:32:32 +02:00
  • ca23f8ee6d cuda : assert ggml_add sources to be contiguous Georgi Gerganov 2023-11-19 10:32:08 +02:00
  • e2f0eba2d4 ios : sync submodule Georgi Gerganov 2023-11-17 10:42:04 +02:00
  • d4353e48f7 sync : ggml (ggml-alloc + linker + gguf fixes) (#1501) Georgi Gerganov 2023-11-17 10:00:07 +02:00
  • bebf0da983 quantize : add support for K-quant types Georgi Gerganov 2023-11-16 16:18:24 +02:00
  • 848e54f3ad bench : fix memcpy bench size Georgi Gerganov 2023-11-16 10:59:32 +02:00
  • 7883d1cae4 talk-llama : improve quote and backtick handling (#1364) Sam Pullara 2023-11-16 00:34:05 -08:00
  • ccc85b4ff8 talk-llama : enable GPU by default Georgi Gerganov 2023-11-15 21:32:25 +02:00
  • c7606b47df models : add info about distilled models Georgi Gerganov 2023-11-15 21:10:13 +02:00
  • d38af151a1 release : v1.5.0 Georgi Gerganov 2023-11-15 21:02:52 +02:00
  • 94267df08e bench-all : add distil models Georgi Gerganov 2023-11-15 20:49:12 +02:00
  • 8713c67133 js : latest whisper.js Georgi Gerganov 2023-11-15 20:10:16 +02:00
  • 57a60639bb bench-all : indentations Georgi Gerganov 2023-11-15 20:01:15 +02:00
  • bfbaa4dce5 whisper : make large version explicit + fix data size units (#1493) Georgi Gerganov 2023-11-15 19:42:25 +02:00
  • 1d79e78402 java : fix test (#1492) Georgi Gerganov 2023-11-15 17:42:53 +02:00
  • b6c5f49b78 whisper : add batched decoding (#1486) Georgi Gerganov 2023-11-15 16:12:52 +02:00
  • d4231649e6 java : use tiny.en for tests (#1484) Georgi Gerganov 2023-11-13 16:53:55 +02:00
  • 3e5c7feeff whisper : add grammar-based sampling (#1229) Evan Jones 2023-11-13 03:51:34 -05:00
  • c23598e4ca talk-llama : add n_gpu_layers parameter (#1475) rlapray 2023-11-13 09:04:16 +01:00
  • 54a08bde29 examples : add whisper.android.java for compatibility with older Android versions using Java (#1382) Tong Li 2023-11-12 06:31:58 -10:00
  • 9f8bbd3fee readme : update comment about source code Georgi Gerganov 2023-11-12 17:47:37 +02:00