mirror of
https://github.com/huggingface/text-generation-inference.git
synced 2026-10-12 02:15:47 +00:00
Daniël de KokandNicolas Patry
ed96ba6503
* flashinfer 0.2.0.post1 -> post2 * Fix ruff stuff. --------- Co-authored-by: Nicolas Patry <[email protected]>
7 lines
384 B
Plaintext
7 lines
384 B
Plaintext
install-flashinfer:
|
|
# We need fsspec as an additional dependency, but
|
|
# `pip install flashinfer` cannot resolve it.
|
|
uv pip install fsspec sympy==1.13.1 numpy
|
|
uv pip install -U setuptools
|
|
TORCH_CUDA_ARCH_LIST="7.5;8.0;8.6;8.9;9.0+PTX" FLASHINFER_ENABLE_AOT=1 pip install git+https://github.com/flashinfer-ai/[email protected]#egg=flashinfer-python --no-build-isolation
|