huggingface/text-generation-inference
1
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2026-10-12 02:15:47 +00:00
Code Issues Packages Projects Releases Wiki Activity

maintenance mode

Browse Source
This commit is contained in:
Julien Chaumond
2025-12-11 14:49:38 +01:00
committed by GitHub
parent 55f7f7cb8b
commit 52c6dddf97
1 changed files with 5 additions and 5 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+5 -5
View File
@@ -1,3 +1,8 @@
> [!CAUTION]
> text-generation-inference is now in maintenance mode. Going forward, we will accept pull requests for minor bug fixes, documentation improvements and lightweight maintenance tasks.
>
> TGI has initiated the movement for optimized inference engines to rely on a `transformers` model architectures. This approach is now adopted by downstream inference engines, which we contribute to and recommend using going forward: [vllm](https://github.com/vllm-project/vllm), [SGLang](https://github.com/sgl-project/sglang), as well as local engines with inter-compatibility such as llama.cpp or MLX.
<div align="center">
<a href="https://www.youtube.com/watch?v=jlMAX2Oaht0">
@@ -18,11 +23,6 @@ to power Hugging Chat, the Inference API and Inference Endpoints.
</div>
> [!CAUTION]
> text-generation-inference is now in maintenance mode. Going forward, we will accept pull requests for minor bug fixes, documentation improvements and lightweight maintenance tasks.
>
> TGI has initiated the movement for optimized inference engines to rely on a `transformers` model architectures. This approach is now adopted by downstream inference engines, which we contribute to and recommend using going forward: [vllm](https://github.com/vllm-project/vllm), [SGLang](https://github.com/sgl-project/sglang), as well as local engines with inter-compatibility such as llama.cpp or MLX.
## Table of contents
- [Get Started](#get-started)