JupiterZhu/T2MLR_135M_lstart13_lend18_10B_FineWebEdu
Text Generation • 0.2B • Updated • 14
T2MLR
T2MLR pretraining checkpoints: 3 scales x 2 token budgets, trained from scratch on FineWeb-Edu.
-
-
JupiterZhu/T2MLR_135M_lstart13_lend18_50B_FineWebEdu
Text Generation • 0.2B • Updated • 12 -
JupiterZhu/T2MLR_362M_lstart9_lend24_10B_FineWebEdu
Text Generation • 0.4B • Updated • 7 -
JupiterZhu/T2MLR_362M_lstart9_lend24_50B_FineWebEdu
Text Generation • 0.4B • Updated • 10 -
JupiterZhu/T2MLR_982M_lstart9_lend24_10B_FineWebEdu
Text Generation • 1B • Updated • 9 -
JupiterZhu/T2MLR_982M_lstart9_lend24_50B_FineWebEdu
Text Generation • 1B • Updated • 11 -
JupiterZhu/T2MLR_Baseline_136M_10B_FineWebEdu
Text Generation • 0.1B • Updated • 610 -
JupiterZhu/T2MLR_Baseline_368M_10B_FineWebEdu
Text Generation • 0.4B • Updated • 625 -
JupiterZhu/T2MLR_Baseline_997M_10B_FineWebEdu
Text Generation • 1.0B • Updated • 657 -
JupiterZhu/T2MLR_Baseline_136M_50B_FineWebEdu
Text Generation • 0.1B • Updated • 658 -
JupiterZhu/T2MLR_Baseline_368M_50B_FineWebEdu
Text Generation • 0.4B • Updated • 670 -
JupiterZhu/T2MLR_Baseline_997M_50B_FineWebEdu
Text Generation • 1.0B • Updated • 666