Filter

Clear Filter

Archived Not Archived

Forked Not Forked

Mirrored Not Mirrored

Template Not Template

Private Public

Sort

Newest Oldest Alphabetically Reverse alphabetically Most recently updated Least recently updated Most stars Fewest stars Most forks Fewest forks Smallest size Largest size

NVIDIA/ TensorRT-LLM

0 0 0

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

blackwell cuda llm-serving moe pytorch

Updated 2026-10-11 21:11:56 +00:00

sgl-project/ sglang

0 0 0

SGLang is a high-performance serving framework for large language models and multimodal models.

attention blackwell cuda deepseek diffusion glm gpt-oss inference llama llm minimax moe qwen qwen-image reinforcement-learning transformer vlm wan

Updated 2026-10-11 21:11:39 +00:00

vllm-project/ vllm

0 0 0

A high-throughput and memory-efficient inference and serving engine for LLMs

amd blackwell cuda deepseek deepseek-v3 gpt gpt-oss inference kimi llama llm llm-serving model-serving moe openai pytorch qwen qwen3 tpu transformer

Updated 2026-10-11 21:09:45 +00:00