A high-throughput and memory-efficient inference and serving engine for LLMs
Updated 2026-10-11 21:09:45 +00:00
Clean-room AGPL-3.0 reimplementation of the halogen 0.1.3 inference engine for Qwen3.8-27B on AMD Strix Halo (gfx1151) — same wire protocol and OpenAI-compatible API. Not affiliated with Peonist.
Updated 2026-09-10 00:01:30 +00:00