activation / tests

Commit History

feat: support sequence parallel with fused_add_rms_norm

151bb5a

wyldecat commited on Oct 13, 2025

refactor(activation): change fused_add_rms_norm and fused_add_rms_norm_backward to out-place operations

7e4334d

wyldecat commited on Oct 13, 2025

feat: support sequence parallel with rms_norm

06d6367

wyldecat commited on Oct 1, 2025

feat: make rms_norm as out-place

9d0a235

wyldecat commited on Oct 1, 2025

Fix fused add rms norm (#4)

a1e5ca8
unverified

TaehyunKim

TaehyunKimMotif commited on Sep 9, 2025

Add fusion (#3)

e5e2eeb
unverified

TaehyunKim

TaehyunKimMotif commited on Sep 8, 2025

Optimize kernel (#2)

97825b8
verified

TaehyunKimMotif commited on Aug 22, 2025

feat(rms-norm): Impl fused RMSNorm

f3b99fb

iamwyldecat commited on Jun 28, 2025

feat(poly-norm): add perf test

d14fd4d

iamwyldecat commited on Jun 10, 2025

fix(poly-norm): calc param grad explicitly

704692b

iamwyldecat commited on Jun 4, 2025

chore(poly-norm): remove unnecessary file

552d415

iamwyldecat commited on Jun 2, 2025

feat(poly-norm): Add PolyNorm

44e9845

iamwyldecat commited on May 30, 2025

Commit History

feat: support sequence parallel with fused_add_rms_norm 151bb5a

refactor(activation): change fused_add_rms_norm and fused_add_rms_norm_backward to out-place operations 7e4334d

feat: support sequence parallel with rms_norm 06d6367

feat: make rms_norm as out-place 9d0a235

Fix fused add rms norm (#4) a1e5ca8 unverified

Add fusion (#3) e5e2eeb unverified

Optimize kernel (#2) 97825b8 verified

feat(rms-norm): Impl fused RMSNorm f3b99fb

feat(poly-norm): add perf test d14fd4d

fix(poly-norm): calc param grad explicitly 704692b

chore(poly-norm): remove unnecessary file 552d415

feat(poly-norm): Add PolyNorm 44e9845