liangsu9988 commited on
Commit
e07f618
·
verified ·
1 Parent(s): af9e65b

Initialize legacy kernels compatibility mirror

Browse files
Files changed (1) hide show
  1. README.md +6 -29
README.md CHANGED
@@ -1,32 +1,9 @@
1
- # flashrt-flex-attention-train
2
 
3
- FlexAttention replacement training package for PI-style dual-expert
4
- transformers.
5
 
6
- Hub repo: `flashrt/flashrt-flex-attention-train`
7
 
8
- ## Public API
9
-
10
- - `flex_attention`
11
- - `flex_attention_forward`
12
- - `reference_flex_attention`
13
- - `build_block_sparse_bool_masks`
14
- - `backend_marker`
15
-
16
- ## Scope
17
-
18
- This package locks the public Tensor API and correctness harness for a native
19
- replacement of the PI052 FlexAttention/SDPA attention path:
20
-
21
- - prefix self-attention rows
22
- - action-to-prefix rows plus block-diagonal action rows
23
- - `head_dim=256`
24
- - BF16 forward/backward through PyTorch autograd fallback
25
- - detached-prefix semantics for action rows reading prefix K/V
26
- - prefix mask, prefix padding mask, action block mask, and action padding mask
27
- - automatic SDPA fallback for unsupported shapes
28
-
29
- The current implementation is the SDPA-backed training reference. It is meant
30
- to be the stable integration target for native CUDA fwd/bwd kernels; no native
31
- performance claim is made until the benchmark gates in `VALIDATION.md` pass on
32
- both A100 and RTX 5090.
 
1
+ # flashrt/flashrt-flex-attention-train
2
 
3
+ This repository is a compatibility mirror for older `kernels` clients
4
+ that resolve repositories through the default Hugging Face model repo API.
5
 
6
+ Canonical Kernel Hub repo: https://huggingface.co/kernels/flashrt/flashrt-flex-attention-train
7
 
8
+ Do not edit this mirror by hand. It is generated from the Kernel Hub
9
+ `vN` branches and contains the same `build/**` artifacts.