konwoo/300m4kcda-203Mx8-dcr-plus-z8-pow-0.75-cos-lr0.0030-wd0.40-bs64
0.3B • Updated • 12
Konwoo Kim
konwoo
·
AI & ML interests
None yet
Recent Activity
updated a collection 7 days ago
Data-efficient pre-training by scaling synthetic megadocs updated a collection 7 days ago
Data-efficient pre-training by scaling synthetic megadocs updated a collection 7 days ago
Data-efficient pre-training by scaling synthetic megadocsOrganizations
konwoo/300m4kcda-203Mx8-dcr-plus-z4-pow-0.75-cos-lr0.0030-wd0.80-bs64
0.3B • Updated • 11
konwoo/300m4kcda-203Mx8-dcr-plus-w2-pow-0.75-cos-lr0.0030-wd0.80-bs64
0.3B • Updated • 12
konwoo/300m4kcda-203Mx8-dcr-plus-s8-pow-0.75-cos-lr0.0030-wd0.80-bs64
0.3B • Updated • 12
konwoo/300m4kcda-203Mx8-dcr-plus-s4-pow-0.75-cos-lr0.0030-wd0.80-bs64
0.3B • Updated • 11
konwoo/300m4kcda-203Mx8-dcr-plus-b4-pow-0.75-cos-lr0.0030-wd0.40-bs64
0.3B • Updated • 12
konwoo/300m4kcda-203Mx4-dcr-plus-z2-pow-0.75-cos-lr0.0030-wd0.80-bs64
0.3B • Updated • 9
konwoo/300m4kcda-203Mx4-dcr-plus-w2s-pow-0.75-cos-lr0.0030-wd0.80-bs64
0.3B • Updated • 10
konwoo/300m4kcda-203Mx32-dcr-plus-z32-pow-0.9-cos-lr0.0010-wd0.40-bs64
0.3B • Updated • 12
konwoo/300m4kcda-203Mx32-dcr-plus-b32-pow-0.9-cos-lr0.0010-wd0.40-bs64
0.3B • Updated • 8
konwoo/300m4kcda-203Mx16-dcr-cos-lr0.0030-wd1.60-bs64
0.3B • Updated • 12
konwoo/300m4kcda-203Mx16-dcr-plus-z16-pow-0.75-cos-lr0.0030-wd0.40-bs64
0.3B • Updated • 11
konwoo/300m4kcda-203Mx16-dcr-plus-s32-pow-0.75-cos-lr0.0030-wd0.40-bs64
0.3B • Updated • 12
konwoo/300m4kcda-203Mx16-dcr-plus-s16-pow-0.75-cos-lr0.0030-wd0.40-bs64
0.3B • Updated • 12
konwoo/300m4kcda-203Mx16-dcr-plus-b8-pow-0.75-cos-lr0.0030-wd0.40-bs64
0.3B • Updated • 11
konwoo/300m4kcda-203Mx16-dcr-plus-b16-pow-0.75-cos-lr0.0030-wd0.40-bs64
0.3B • Updated • 13
konwoo/600m4k-209Mx8-dclm-cos-lr0.0010-wd3.20-seed0
0.6B • Updated
konwoo/600m4k-209Mx4-dclm-cos-lr0.0010-wd0.10-bs64
0.6B • Updated
konwoo/600m4k-209Mx16-dclm-cos-lr0.0010-wd1.60-seed4
0.6B • Updated
konwoo/600m4k-209Mx16-dclm-cos-lr0.0010-wd1.60-seed3
0.6B • Updated
konwoo/600m4k-209Mx16-dclm-cos-lr0.0010-wd1.60-seed2
0.6B • Updated • 1
konwoo/600m4k-209Mx16-dclm-cos-lr0.0010-wd1.60-seed1
0.6B • Updated
konwoo/600m4k-209Mx16-dclm-cos-lr0.0010-wd1.60-seed0
0.6B • Updated
konwoo/300m4k-209Mx8-dclm-cos-lr0.0010-wd0.10-bs64
0.3B • Updated
konwoo/300m4k-209Mx32-dclm-cos-lr0.0030-wd0.80-seed4
0.3B • Updated
konwoo/300m4k-209Mx32-dclm-cos-lr0.0030-wd0.80-seed3
0.3B • Updated
konwoo/300m4k-209Mx32-dclm-cos-lr0.0030-wd0.80-seed2
0.3B • Updated
konwoo/300m4k-209Mx32-dclm-cos-lr0.0030-wd0.80-seed1
0.3B • Updated
konwoo/300m4k-209Mx32-dclm-cos-lr0.0030-wd0.80-seed0
0.3B • Updated
konwoo/300m4k-209Mx16-dclm-cos-lr0.0030-wd1.60-seed0
0.3B • Updated