konwoo/300m4k-209Mx16-dclm-sd0805-0.75-cos-lr0.0030-wd0.10-bs64
0.3B • Updated • 2
Konwoo Kim
konwoo
AI & ML interests
None yet
Recent Activity
updated a dataset 2 days ago
konwoo/dclm-1k-val-llama8b-hq-cpr4-ml1024 published a dataset 2 days ago
konwoo/dclm-1k-val-llama8b-hq-cpr4-ml1024 updated a collection 2 days ago
Data-efficient pre-training by scaling synthetic megadocsOrganizations
konwoo/300m4k-209Mx16-dclm-ens8x0730-0.9-cos-lr0.0030-wd0.10-bs64
0.3B • Updated • 1
konwoo/1_4b4k-209Mx8-dclm-cos-lr0.0010-wd3.20-seed0
1B • Updated • 2
konwoo/1_4b4k-209Mx4-dclm-cos-lr0.0003-wd0.10-bs64
1B • Updated • 1
konwoo/1_4b4k-209Mx16-dclm-cos-lr0.0010-wd1.60-seed4
1B • Updated • 1
konwoo/1_4b4k-209Mx16-dclm-cos-lr0.0010-wd1.60-seed3
1B • Updated • 1
konwoo/1_4b4k-209Mx16-dclm-cos-lr0.0010-wd1.60-seed2
1B • Updated • 1
konwoo/1_4b4k-209Mx16-dclm-cos-lr0.0010-wd1.60-seed1
1B • Updated • 2
konwoo/1_4b4k-209Mx16-dclm-cos-lr0.0010-wd1.60-seed0
1B • Updated • 2
konwoo/150m4k-209Mx8-dclm-cos-lr0.0030-wd0.10-bs64
0.2B • Updated • 429
konwoo/150m4k-209Mx32-dclm-cos-lr0.0030-wd0.40-seed4
0.2B • Updated • 1
konwoo/150m4k-209Mx32-dclm-cos-lr0.0030-wd0.40-seed3
0.2B • Updated • 1
konwoo/150m4k-209Mx32-dclm-cos-lr0.0030-wd0.40-seed2
0.2B • Updated • 1
konwoo/150m4k-209Mx32-dclm-cos-lr0.0030-wd0.40-seed1
0.2B • Updated • 1
konwoo/150m4k-209Mx32-dclm-cos-lr0.0030-wd0.40-seed0
0.2B • Updated • 1
konwoo/150m4k-209Mx16-dclm-cos-lr0.0030-wd0.80-seed0
0.2B • Updated • 1