🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
Updated 2026-10-11 21:18:10 +00:00
SGLang is a high-performance serving framework for large language models and multimodal models.
Updated 2026-10-11 21:11:39 +00:00
A high-throughput and memory-efficient inference and serving engine for LLMs
Updated 2026-10-11 21:09:45 +00:00
Port of OpenAI's Whisper model in C/C++
Updated 2026-10-11 04:01:46 +00:00
Faster Whisper transcription with CTranslate2
Updated 2026-10-10 03:39:41 +00:00
A framework for few-shot evaluation of language models.
Updated 2026-09-14 10:51:05 +00:00
Large Language Model Text Generation Inference
Updated 2026-03-21 11:34:22 +00:00