Filter

Clear Filter

Archived Not Archived

Forked Not Forked

Mirrored Not Mirrored

Template Not Template

Private Public

Sort

Newest Oldest Alphabetically Reverse alphabetically Most recently updated Least recently updated Most stars Fewest stars Most forks Fewest forks Smallest size Largest size

Lightning-AI/ litgpt

Python 0 0 0

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

ai artificial-intelligence deep-learning large-language-models llm llm-inference llms

Updated 2026-10-07 16:59:36 +00:00

bentoml/ BentoML

Python 0 0 0

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

ai-inference deep-learning generative-ai inference-platform llm llm-inference llm-serving llmops machine-learning ml-engineering mlops model-inference-service model-serving multimodal python

Updated 2026-10-05 17:17:20 +00:00

Heretek-AI/ CachyLLama-BUILDER

Python 0 0 0

🚀 Automated nightly builds & multi-backend releases (ROCm 7 TheRock, Vulkan RADV, CUDA, Metal) for CachyLLama & llama-ai on AMD Strix Halo (8060S), Strix Point (890M), Phoenix (780M), and Steam Deck with Homebrew support.

amd-apu cachyllama deepseek-v4 hip homebrew kv-cache llama-ai llama-cpp llm-inference nightly-builds portable-binaries radeon-8060s radeon-890m radv rocm rocm-7 steam-deck strix-halo strix-point vulkan

Updated 2026-09-05 19:31:50 +00:00

Heretek-AI/ ember-BUILDER

Python 0 0 0

⚡ Automated nightly builds & portable ROCm 7 releases of Ember for DeepSeek-V4-Flash on AMD Strix Halo (gfx1151 / Radeon 8060S). Standalone C inference server with bundled ROCm runtime, continuous batching, and Homebrew support.

ai-inference amd-apu c-inference continuous-batching deepseek-v4 dflash ember gfx1151 gguf hip homebrew llm-inference nightly-builds portable-binaries radeon-8060s rdna3-5 rocm rocm-7 strix-halo the-rock

Updated 2026-08-31 03:00:27 +00:00

Heretek-AI/ lucebox-BUILDER

Python 0 0 0

⚡ Automated nightly builds & portable releases for lucebox (DFlash) inference server on NVIDIA CUDA (sm_75-120) and AMD ROCm 7 (Strix Halo gfx1151, RX 7900 XTX gfx1100, R9700 gfx1201) with zero-dependency $ORIGIN RPATH bundling.

ai-inference cuda deepseek-v3 deepseek-v4 dflash gfx1100 gfx1151 gfx1201 hip llm-inference lucebox nightly-builds portable-binaries rdna3 rdna4 rocm rocm-7 rtx5090 rx7900xtx strix-halo

Updated 2026-08-31 01:02:00 +00:00