Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.
Updated 2026-10-11 21:18:12 +00:00
SGLang is a high-performance serving framework for large language models and multimodal models.
Updated 2026-10-11 21:11:39 +00:00