yindo/flash-attention

Fork 0

mirror of https://github.com/BillyOutlast/flash-attention.git synced 2026-07-01 21:04:02 -04:00

Files

T

History

Driss Guessous 72c7ba484d Fix Hopper tests (#2242 )

2026-02-08 09:25:01 -08:00

__init__.py

[Cute] Optionally dump cubin and sass

2025-10-12 00:52:28 -04:00

.flake8

[Cute] Add flake8 config file

2025-10-18 17:19:12 -04:00

ampere_helpers.py

Add precommit list and then uncomment in chunks (#1941 )

2025-10-15 12:24:52 -07:00

AUTHORS

[Cute] Add authors

2025-11-24 23:45:34 -05:00

barrier.py

[CuTe DSL] Update "buffers" name to "aux_tensors"; fix flex bugs (#1961 )

2025-10-23 20:41:37 -07:00

benchmark.py

[Cute] Copy benchmark util functions to cute directory

2025-10-27 17:10:10 -04:00

blackwell_helpers.py

[Cute,Bwd,Sm100] Use TS MMA for dK

2025-10-28 17:50:38 -04:00

block_info.py

[Cute,Bwd,Sm100] Add local for sm100 bwd (#2046 )

2025-12-05 16:11:10 -08:00

block_sparse_utils.py

[Bwd,Sm90] Have score_mod and score_mod_bwd as partial functions

2026-02-08 22:10:05 +07:00

block_sparsity.py

[Cute][Flex] Allow q_offset 1 and add block-sizes to disambiguate edge cases (#2187 )

2026-01-21 17:25:32 -08:00

compute_block_sparsity.py

[Cute][Flex] Allow q_offset 1 and add block-sizes to disambiguate edge cases (#2187 )

2026-01-21 17:25:32 -08:00

copy_utils.py

ruff all the smaller files (#2040 )

2025-12-02 13:43:24 -08:00

cute_dsl_ptxas.py

[DSL] Optionally patch cute-dsl to use system's ptxas

2026-01-27 21:09:36 +07:00

cute_dsl_utils.py

[CUTE]Bump to Cutedsl (#2216 )

2026-02-07 18:32:44 -08:00

fast_math.py

Bump pin (#2025 )

2025-11-25 12:38:30 -08:00

flash_bwd_postprocess.py

[Layout] Use layout_utils.transpose_view and select from quack

2026-02-08 18:24:28 +07:00

flash_bwd_preprocess.py

[CUTE]Bump to Cutedsl (#2216 )

2026-02-07 18:32:44 -08:00

flash_bwd_sm90.py

[DSL] warpgroup_reg_alloc -> setmaxregister_increase

2026-02-08 22:17:36 +07:00

flash_bwd_sm100.py

[DSL] warpgroup_reg_alloc -> setmaxregister_increase

2026-02-08 22:17:36 +07:00

flash_bwd.py

[Layout] Use layout_utils.transpose_view and select from quack

2026-02-08 18:24:28 +07:00

flash_fwd_combine.py

[DSL] Use cute.math.{exp2,log2,log}

2026-02-08 18:02:19 +07:00

flash_fwd_sm100.py

[DSL] warpgroup_reg_alloc -> setmaxregister_increase

2026-02-08 22:17:36 +07:00

flash_fwd.py

[DSL] warpgroup_reg_alloc -> setmaxregister_increase

2026-02-08 22:17:36 +07:00

interface.py

Fix Hopper tests (#2242 )

2026-02-08 09:25:01 -08:00

LICENSE

Add LICENSE and AUTHORS to flash_attn/cute (#2032 )

2025-11-24 20:42:02 -08:00

mask.py

[Layout] Use reshape_acc_to_mn and reshape_acc_to_frgA from quack

2026-02-08 16:48:16 +07:00

mma_sm100_desc.py

[Cute] Format mma_sm100_desc.py, seqlen_info.py

2025-10-19 12:15:32 -04:00

named_barrier.py

[Cute,Bwd,Sm100] Have a separate function to set up the mma

2025-10-19 15:54:34 -04:00

pack_gqa.py

[Layout] Use reshape_acc_to_mn and reshape_acc_to_frgA from quack

2026-02-08 16:48:16 +07:00

paged_kv.py

[Cute,Fwd,Sm100] distributed offset calculation for paged KV (#2104 )

2026-01-15 12:11:01 -08:00

pipeline.py

[Bwd,Sm100] Shorten PipelineTmaUmma create

2026-02-08 21:11:17 +07:00

pyproject.toml

[Layout] Use reshape_acc_to_mn and reshape_acc_to_frgA from quack

2026-02-08 16:48:16 +07:00

README.md

short readme for flex flash (#2231 )

2026-02-04 18:30:56 -08:00

seqlen_info.py

[Cute, Bwd, Sm100] Add varlen for sm100 bwd (#2150 )

2026-01-09 15:24:29 -08:00

softmax.py

[DSL] Use cute.math.{exp2,log2,log}

2026-02-08 18:02:19 +07:00

testing.py

[Cute, Bwd, Sm100] Add varlen for sm100 bwd (#2150 )

2026-01-09 15:24:29 -08:00

tile_scheduler.py

[Cute, Bwd, Sm100] Add varlen for sm100 bwd (#2150 )

2026-01-09 15:24:29 -08:00

utils.py

[Layout] Use layout_utils.transpose_view and select from quack

2026-02-08 18:24:28 +07:00

README.md

Flash Attention CUTE

Development Installation

Clone the repository (if you haven't already):

git clone https://github.com/Dao-AILab/flash-attention.git
cd flash-attention/cute

Install in editable mode with dev dependencies:
```
pip install -e "./cute[dev]"
```

Running Tests

pytest tests/cute/

Linting

ruff check flash_attn/cute/