Hugging Face's logo

Motif-Technologies
/
activation

Kernels
Model card Files
xet
 Community
4
activation / tests

Commit History

Merge pull request #22 from MotifTechnologies/jangwoong/mla-rope-fa4-port
5adea7d
unverified

Jangwoong Kim commited on

test: numerical parity for MLA RoPE fused kernels vs PyTorch reference
0c42208

3v324v23 Claude Opus 4.6 (1M context) commited on

fix: unify all backward kernels to input-based math + fix test import
09ecd67

wyldecat Claude Opus 4.6 (1M context) commited on

style: fix yapf/isort formatting for CI --all-files check
3f2678c

wyldecat Claude Opus 4.6 (1M context) commited on

grouped polynorm with padding aware (#19)
972d63b
unverified

TaehyunKim commited on

style: apply yapf, isort, and clang-format
6436ad6

wyldecat Claude Opus 4.6 (1M context) commited on

fix: rename stale references and clean up Triton remnants
5a9d09d

wyldecat Claude Opus 4.6 (1M context) commited on

refactor: remove Triton kernels, add hidden_clamp to unscored ops
906e125

wyldecat Claude Opus 4.6 (1M context) commited on

test: add scores and hidden_clamp tests for fused_mul_grouped_poly_norm
f06406d

wyldecat Claude Opus 4.6 (1M context) commited on

feat: add GroupedFusedMulPolyNorm Triton kernel for MoE models (#16)
e195bbb
unverified

TaehyunKim Claude Opus 4.6 github-actions[bot] commited on

fix: fix fused add rms norm sharding strategy
a35a092

wyldecat commited on

fix: fix rms norm sharding strategy
138159c

wyldecat commited on

feat: support sequence parallel with fused_add_rms_norm
151bb5a

wyldecat commited on

refactor(activation): change fused_add_rms_norm and fused_add_rms_norm_backward to out-place operations
7e4334d

wyldecat commited on

feat: support sequence parallel with rms_norm
06d6367

wyldecat commited on

feat: make rms_norm as out-place
9d0a235

wyldecat commited on

Fix fused add rms norm (#4)
a1e5ca8
unverified

TaehyunKim TaehyunKimMotif commited on

Add fusion (#3)
e5e2eeb
unverified

TaehyunKim TaehyunKimMotif commited on

feat(rms-norm): Impl fused RMSNorm
f3b99fb

iamwyldecat commited on

feat(poly-norm): add perf test
d14fd4d

iamwyldecat commited on

fix(poly-norm): calc param grad explicitly
704692b

iamwyldecat commited on

chore(poly-norm): remove unnecessary file
552d415

iamwyldecat commited on

feat(poly-norm): Add PolyNorm
44e9845

iamwyldecat commited on