huggingface/text-generation-inference
1
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2026-10-12 02:15:47 +00:00
Code Issues Packages Projects Releases Wiki Activity

Maintenance mode (#3344)

Browse Source 
* Maintenance mode

Maintenance mode

* Light reword

* Light reword

* Light reword
This commit is contained in:
Lysandre Debut
2025-12-11 14:05:46 +01:00
committed by GitHub
parent 24ee40d143
commit 55f7f7cb8b
1 changed files with 5 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+5
View File
@@ -18,6 +18,11 @@ to power Hugging Chat, the Inference API and Inference Endpoints.
</div>
> [!CAUTION]
> text-generation-inference is now in maintenance mode. Going forward, we will accept pull requests for minor bug fixes, documentation improvements and lightweight maintenance tasks.
>
> TGI has initiated the movement for optimized inference engines to rely on a `transformers` model architectures. This approach is now adopted by downstream inference engines, which we contribute to and recommend using going forward: [vllm](https://github.com/vllm-project/vllm), [SGLang](https://github.com/sgl-project/sglang), as well as local engines with inter-compatibility such as llama.cpp or MLX.
## Table of contents
- [Get Started](#get-started)