This website requires JavaScript.
Explore
Help
Sign In
huggingface
/
text-generation-inference
Watch
1
Star
0
Fork
0
mirror of
https://github.com/huggingface/text-generation-inference.git
synced
2026-10-12 02:15:47 +00:00
Code
Issues
Packages
Projects
Releases
Wiki
Activity
Files
ebb26f0ccd8eb8a9d2defa7ba8acbd6c1d3401ae
text-generation-inference
/
backends
T
History
Wang, Yi
ebb26f0ccd
[gaudi] Deepseek v2 mla and add ep to unquantized moe (
#3287
)
...
Signed-off-by: Wang, Yi A <
[email protected]
>
2025-07-07 11:29:39 +02:00
..
client
Revert "feat: improve qwen2-vl startup " (
#2924
)
2025-01-17 12:09:05 -05:00
gaudi
[gaudi] Deepseek v2 mla and add ep to unquantized moe (
#3287
)
2025-07-07 11:29:39 +02:00
grpc-metadata
Upgrading our rustc version. (
#2908
)
2025-01-15 17:04:03 +01:00
llamacpp
Add option to configure prometheus port (
#3187
)
2025-04-23 20:43:25 +05:30
neuron
Neuron backend fix and patch version 3.3.4 (
#3273
)
2025-06-19 10:52:41 +02:00
trtllm
Add option to configure prometheus port (
#3187
)
2025-04-23 20:43:25 +05:30
v2
Add option to configure prometheus port (
#3187
)
2025-04-23 20:43:25 +05:30
v3
fp8 compressed tensors w8a8 support for Gaudi backend (
#3242
)
2025-05-28 14:54:20 +02:00
