vapavlo/SmolLM3-SWA-VPAD-p30
3B • Updated • 6
Length Generalization Needs Proper Regularization
-
-
vapavlo/SmolLM3-SWA-8K-VPAD-p30-scaled
3B • Updated • 9 -
vapavlo/SmolLM3-SWA-8K-pre-linear-p30-scaled
3B • Updated • 9 -
vapavlo/SmolLM3-SWA-WD
3B • Updated • 11 -
vapavlo/SmolLM3-SWA-pre-norm-p30
3B • Updated • 12 -
vapavlo/SmolLM3-SWA-pre-linear-p30
3B • Updated • 8 -
vapavlo/SmolLM3-SWA-VPAD-p10
3B • Updated • 6 -
vapavlo/SmolLM3-SWA-VPAD-p20
3B • Updated • 7 -
vapavlo/Mamba2-1.3B-wd
1B • Updated • 7 -
vapavlo/Mamba2-1.3B-VPAD-p20
1B • Updated • 9 -
vapavlo/Mamba2-1.3B-pre-linear-p20
1B • Updated • 6 -
vapavlo/Mamba2-1.3B-pre-norm-p20
1B • Updated • 6