Kernels:

aws-neuron
/

vit-encoder-neuron-kernels

Kernel card Files Files and versions

vit-encoder-neuron-kernels / build /torch-neuron /nki_kernels

225 kB

Ctrl+K

Ctrl+K

1 contributor

History: 8 commits

jburtoft's picture

CHANGELOG and comment wording

6da9fa8 about 22 hours ago

__init__.py

945 Bytes
v1.3: attention-path schedule improvements (bitwise identical to v1.2) + SwiGLU fallback fix 4 days ago
attention_block.py

52.6 kB
CHANGELOG and comment wording about 22 hours ago
attention_block_l1.py

21.7 kB
v1.5: two images per attention producer pass (LNC=1, <=256 tokens) + fix for <=128-token inputs 3 days ago
attention_block_l1_ln.py

26.8 kB
v1.5: two images per attention producer pass (LNC=1, <=256 tokens) + fix for <=128-token inputs 3 days ago
attention_inner.py

58.7 kB
v1.5: two images per attention producer pass (LNC=1, <=256 tokens) + fix for <=128-token inputs 3 days ago
mlp.py

15.1 kB
v1.1: K4 (mlp/mlp_res_ln) + K1/K3 (res_layernorm) DMA/engine-schedule rework 6 days ago
mlp_fp8.py

12.3 kB
v1.4: 5-bank QK^T PSUM rotation (<=1024 tokens) + experimental opt-in FP8 MLP 3 days ago
mlp_res_ln.py

11.7 kB
v1.1: K4 (mlp/mlp_res_ln) + K1/K3 (res_layernorm) DMA/engine-schedule rework 6 days ago
res_layernorm.py

10.3 kB
v1.1: K4 (mlp/mlp_res_ln) + K1/K3 (res_layernorm) DMA/engine-schedule rework 6 days ago
swiglu_stream.py

15.3 kB
v1.2: packed-bias one-DMA for SwiGLU (swiglu_stream/_ln) 5 days ago