mirror of
https://github.com/invoke-ai/InvokeAI.git
synced 2026-10-12 02:16:43 +00:00
The rocm extra moves from PyTorch's 2.13.0+rocm7.2 (Linux only) to AMD's 2.13.0+rocm10.0.0 for Linux x86_64 and Windows. The lock carries the GPU kernel packages of every target AMD builds, so the launcher can leave out the ones a machine does not need. Linux loses gfx900/gfx906, which ROCm 10 dropped. bitsandbytes moves to 0.50.2, the first release with a Windows ROCm binary. A new setting, rocm_aotriton_experimental (auto/on/off), sets TORCH_ROCM_AOTRITON_ENABLE_EXPERIMENTAL before anything runs attention. auto turns AOTriton's experimental fused kernels on only for a ROCm 10 build on GPUs where they were measured correct (gfx1200 so far); under torch 2.12+rocm7.14 the same switch made every fused call fail on that GPU. Builds on the dependency and documentation changes of #9606. Co-authored-by: 0xDELUXA <[email protected]>
3.5 MiB
3.5 MiB