Repositories Users Organizations
Filter
Sort
Heretek-AI/ homebrew-tap
Python 0 0 0
⚡ Zero-dependency Homebrew tap for high-performance LLMs (CachyLLama, ROCmFPX, llama-ai). Optimized for AMD ROCm 7 (Strix Halo, RDNA3/4), Apple Silicon Metal, & Vulkan RADV.
ai-inference amd-gpu apple-silicon cachy-llama homebrew homebrew-tap inference llama-cpp llm local-ai metal quantization rdna3 rdna4 rocm rocm-gpu rocmfpx strix-halo strix-point vulkan-radv
Updated 2026-10-11 20:01:07 +00:00
bentoml/ BentoML
Python 0 0 0
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
ai-inference deep-learning generative-ai inference-platform llm llm-inference llm-serving llmops machine-learning ml-engineering mlops model-inference-service model-serving multimodal python
Updated 2026-10-05 17:17:20 +00:00
Heretek-AI/ ember-BUILDER
Python 0 0 0
⚡ Automated nightly builds & portable ROCm 7 releases of Ember for DeepSeek-V4-Flash on AMD Strix Halo (gfx1151 / Radeon 8060S). Standalone C inference server with bundled ROCm runtime, continuous batching, and Homebrew support.
ai-inference amd-apu c-inference continuous-batching deepseek-v4 dflash ember gfx1151 gguf hip homebrew llm-inference nightly-builds portable-binaries radeon-8060s rdna3-5 rocm rocm-7 strix-halo the-rock
Updated 2026-08-31 03:00:27 +00:00
Heretek-AI/ lucebox-BUILDER
Python 0 0 0
⚡ Automated nightly builds & portable releases for lucebox (DFlash) inference server on NVIDIA CUDA (sm_75-120) and AMD ROCm 7 (Strix Halo gfx1151, RX 7900 XTX gfx1100, R9700 gfx1201) with zero-dependency $ORIGIN RPATH bundling.
ai-inference cuda deepseek-v3 deepseek-v4 dflash gfx1100 gfx1151 gfx1201 hip llm-inference lucebox nightly-builds portable-binaries rdna3 rdna4 rocm rocm-7 rtx5090 rx7900xtx strix-halo
Updated 2026-08-31 01:02:00 +00:00