Paul Tsochantaris 80753d4da8 metal : single allocation of encode_async block (llama/9747) ...

* Single allocation of encode_async block with non-ARC capture in ggml-metal.m

* Moving Block_release to the deallocation code

* Release encode block when re-setting encoding buffer count if needed

* Update ggml/src/ggml-metal.m

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

2024-11-01 10:19:05 +02:00

..

cmake

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

include

ggml : alloc ggml_contexts on the heap (#2525)

2024-10-31 22:00:09 +02:00

src

metal : single allocation of encode_async block (llama/9747)

2024-11-01 10:19:05 +02:00

.gitignore

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

CMakeLists.txt

cmake : do not hide GGML options + rename option (llama/9465)

2024-09-24 19:45:08 +03:00

ggml_vk_generate_shaders.py

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00