Default Branch

main b4adbf2f6e · docs: add AWS (EC2/SageMaker) deployment + benchmarking guide (#3352) · Updated 2026-03-21 11:34:22 +00:00

ZIP  TAR.GZ

Branches

tmp_invariants ddf0b02240 · All the assertions. · Updated 2025-03-04 12:32:05 +00:00    huggingface	199 2		ZIP  TAR.GZ
proxy_sse_engine_state f72547c9fb · feat(metrics): remove ngrok mandatory feature for backendv3 crate · Updated 2025-02-27 21:56:04 +00:00    huggingface	159 5		ZIP  TAR.GZ
pr-2954-ci-branch efb20054aa · feat: consolidate streaming and event creation logic and add tests for streaming generations · Updated 2025-02-27 16:12:51 +00:00    huggingface	159 22		ZIP  TAR.GZ
zstd 7e60666711 · ?? · Updated 2025-02-21 09:18:56 +00:00    huggingface	169 12		ZIP  TAR.GZ
pr-3018-ci-branch 95d1172347 · fix: bump ci build yaml · Updated 2025-02-17 15:24:25 +00:00    huggingface	186 5		ZIP  TAR.GZ
pr-3002-ci-branch b7250f0473 · Revert "fix: expand logic for different hardware" · Updated 2025-02-11 16:14:02 +00:00    huggingface	190 4		ZIP  TAR.GZ
adjust-mllama-test-output 09631bc8a2 · fix: bump prompt · Updated 2025-02-11 15:15:29 +00:00    huggingface	189 2		ZIP  TAR.GZ
pr-3004-ci-branch eb0194a9c1 · fix qwen2 vl crash in continous batching · Updated 2025-02-10 09:54:45 +00:00    huggingface	190 1		ZIP  TAR.GZ
triton_fix 408663e61a · fix triton to 3.1.0 to fix ipex import issue · Updated 2025-02-06 08:54:03 +00:00    huggingface	194 1		ZIP  TAR.GZ
git_v3.1.0 463228ebfc · Update version number. · Updated 2025-01-31 13:24:45 +00:00    huggingface	199 1		ZIP  TAR.GZ
vllm/setup 5452c1294c · backend(vllm): disable metrics for now · Updated 2025-01-31 09:56:54 +00:00    huggingface	224 9		ZIP  TAR.GZ
add_deepseekv3 b0b855fecd · update doc · Updated 2025-01-29 12:46:03 +00:00    huggingface	229 5		ZIP  TAR.GZ
more_logs c871d74b46 · More logs in the allocator. · Updated 2025-01-28 10:19:37 +00:00    huggingface	210 1		ZIP  TAR.GZ
fix-tp bafbd06744 · Update transformers_flash_causal_lm.py · Updated 2025-01-24 14:06:50 +00:00    huggingface	211 2		ZIP  TAR.GZ
git_v3.0.2 b70f29d729 · Bypasse perm issue. · Updated 2025-01-24 11:12:47 +00:00    huggingface	213 2		ZIP  TAR.GZ
new_minor_version 6d335ca7ce · Remove modifications in Lock. · Updated 2025-01-22 12:37:17 +00:00    huggingface	223 2		ZIP  TAR.GZ
enable-qwen2vl-video 17192c9a0e · fix: remove test debug params · Updated 2025-01-17 16:19:02 +00:00    huggingface	258 54		ZIP  TAR.GZ
response-header-metrics b4187d6022 · Add tgi_batch_current_size and tgi_batch_current_size as response header · Updated 2025-01-17 14:48:02 +00:00    huggingface	233 1		ZIP  TAR.GZ
nix/pytorch-2.5.1 bde5f9ad82 · nix: update to PyTorch 2.5.1 · Updated 2025-01-17 06:44:21 +00:00    huggingface	237 1		ZIP  TAR.GZ
baichuan2-13b 48067e4a0d · fmt · Updated 2025-01-14 01:23:28 +00:00    huggingface	251 3		ZIP  TAR.GZ