huggingface/text-generation-inference
1
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2026-10-12 02:15:47 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
main
text-generation-inference/launcher
T
History
oOraph dfb3fbe78e fix(num_devices): fix num_shard/num device auto compute when NVIDIA_VISIBLE_DEVICES == "all" or "void" (#3346) 
* fix(num_devices): fix num_shard/num devices auto compute when NVIDIA_VISIBLE_DEVICES == "all"
the computed num_shards was always 1 in this case, no matter what

* fix(num_devices): make TGI shard auto compute compliant with nvidia-container-toolkit in cdi mode
2025-12-18 16:58:43 +01:00
..
src
fix(num_devices): fix num_shard/num device auto compute when NVIDIA_VISIBLE_DEVICES == "all" or "void" (#3346)
2025-12-18 16:58:43 +01:00
build.rs
chore(github): add templates (#264)
2023-05-02 15:43:19 +02:00
Cargo.toml
feat: add support for HF_HUB_USER_AGENT_ORIGIN to add user-agent Origin field in Hub requests. (#3061)
2025-03-04 16:43:50 +01:00