konwoo/300m4k-209Mx16-dclm-sd0805-0.75-cos-lr0.0030-wd0.10-bs64
0.3B • Updated
Konwoo Kim
konwoo
·
AI & ML interests
None yet
Recent Activity
updated a collection 7 days ago
Data-efficient pre-training by scaling synthetic megadocs updated a collection 7 days ago
Data-efficient pre-training by scaling synthetic megadocs updated a collection 7 days ago
Data-efficient pre-training by scaling synthetic megadocsOrganizations
konwoo/300m4k-209Mx16-dclm-ens8x0730-0.9-cos-lr0.0030-wd0.10-bs64
0.3B • Updated
konwoo/1_4b4k-209Mx8-dclm-cos-lr0.0010-wd3.20-seed0
1B • Updated
konwoo/1_4b4k-209Mx4-dclm-cos-lr0.0003-wd0.10-bs64
1B • Updated
konwoo/1_4b4k-209Mx16-dclm-cos-lr0.0010-wd1.60-seed4
1B • Updated
konwoo/1_4b4k-209Mx16-dclm-cos-lr0.0010-wd1.60-seed3
1B • Updated
konwoo/1_4b4k-209Mx16-dclm-cos-lr0.0010-wd1.60-seed2
1B • Updated
konwoo/1_4b4k-209Mx16-dclm-cos-lr0.0010-wd1.60-seed1
1B • Updated
konwoo/1_4b4k-209Mx16-dclm-cos-lr0.0010-wd1.60-seed0
1B • Updated
konwoo/150m4k-209Mx8-dclm-cos-lr0.0030-wd0.10-bs64
0.2B • Updated • 66
konwoo/150m4k-209Mx32-dclm-cos-lr0.0030-wd0.40-seed4
0.2B • Updated
konwoo/150m4k-209Mx32-dclm-cos-lr0.0030-wd0.40-seed3
0.2B • Updated
konwoo/150m4k-209Mx32-dclm-cos-lr0.0030-wd0.40-seed2
0.2B • Updated
konwoo/150m4k-209Mx32-dclm-cos-lr0.0030-wd0.40-seed1
0.2B • Updated
konwoo/150m4k-209Mx32-dclm-cos-lr0.0030-wd0.40-seed0
0.2B • Updated
konwoo/150m4k-209Mx16-dclm-cos-lr0.0030-wd0.80-seed0
0.2B • Updated