Filter

Clear Filter

Archived Not Archived

Forked Not Forked

Mirrored Not Mirrored

Template Not Template

Private Public

Sort

Newest Oldest Alphabetically Reverse alphabetically Most recently updated Least recently updated Most stars Fewest stars Most forks Fewest forks Smallest size Largest size

vllm-project/ vllm

0 0 0

A high-throughput and memory-efficient inference and serving engine for LLMs

amd blackwell cuda deepseek deepseek-v3 gpt gpt-oss inference kimi llama llm llm-serving model-serving moe openai pytorch qwen qwen3 tpu transformer

Updated 2026-10-11 21:09:45 +00:00

Heretek-AI/ lucebox-BUILDER

Python 0 0 0

⚡ Automated nightly builds & portable releases for lucebox (DFlash) inference server on NVIDIA CUDA (sm_75-120) and AMD ROCm 7 (Strix Halo gfx1151, RX 7900 XTX gfx1100, R9700 gfx1201) with zero-dependency $ORIGIN RPATH bundling.

ai-inference cuda deepseek-v3 deepseek-v4 dflash gfx1100 gfx1151 gfx1201 hip llm-inference lucebox nightly-builds portable-binaries rdna3 rdna4 rocm rocm-7 rtx5090 rx7900xtx strix-halo

Updated 2026-08-31 01:02:00 +00:00