File size: 728 Bytes
8c8128e | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 | # fa4-cute-runtime
Forward-only, SM100-family FlashAttention-4 CuTe DSL package used by FlashRT's
production GROOT N1.7 and PI0.5 Thor runtimes. In addition to the standard
D48/D72/D128 path, it includes the dedicated D256 2CTA forward kernel needed
by PI0.5's PaliGemma encoder.
The package exposes `flash_attn_func`, `flash_attn_varlen_func`, and the
preallocated `forward_static` CUDA Graph entry, including `seqused_k` for
fixed-shape padded K/V. It keeps the vendored
implementation in the private `flashrt_fa4` namespace and vendors the required
quack helper subset, so it cannot replace or mutate upstream `flash_attn`
imports.
See [CARD.md](CARD.md) for usage and [VALIDATION.md](VALIDATION.md) for the
release gate.
|