FineInstructions: Scaling Synthetic Instructions to Pre-Training Scale
Paper
• 2601.22146 • Published
• 9
AI & ML interests
None defined yet.
Recent Activity
View all activity
AjayP13
authored a paper 26 days ago
AjayP13
updated 19 datasets about 1 month ago
fineinstructions-pretraining/dclm_baseline_1.0_actual_all
Viewer
• Updated
• 2.94B • 65 • 1
fineinstructions-pretraining/fineweb_edu_actual_all
Preview
• Updated
• 301 • 1
fineinstructions-pretraining/ipt_fineinstructions_judged
Viewer
• Updated
• 763k • 18
fineinstructions-pretraining/nemotron_wrap_1T_exp
Viewer
• Updated
• 302M • 182
fineinstructions-pretraining/nemotron_qa_1T_exp
Viewer
• Updated
• 425M • 126
fineinstructions-pretraining/nemotron_actual_1T_exp
Viewer
• Updated
• 302M • 60
fineinstructions-pretraining/nemotron_fineinstructions_1T_exp_chat
Viewer
• Updated
• 721M • 113 • 2
fineinstructions-pretraining/ipt_fineinstructions_all_judged_exp_chat
Viewer
• Updated
• 34.5M • 43
fineinstructions-pretraining/nemotron_synthetic_1T_exp
Viewer
• Updated
• 448M • 55
fineinstructions-pretraining/ipt_synthetic_all_exp
Viewer
• Updated
• 26.6M • 18 • 1
fineinstructions-pretraining/nemotron_actual_1T
Viewer
• Updated
• 746M • 19
fineinstructions-pretraining/longform_synthetic_all
Viewer
• Updated
• 27.7k • 5
fineinstructions-pretraining/ipt_synthetic_all
Viewer
• Updated
• 40M • 27 • 1
fineinstructions-pretraining/ipt_fineinstructions_all_exp
Viewer
• Updated
• 56.3M • 58 • 1
fineinstructions-pretraining/nemotron_wrap_1T
Viewer
• Updated
• 763M • 30 • 1
fineinstructions-pretraining/longform_fineinstructions_all
Viewer
• Updated
• 45.7k • 8
fineinstructions-pretraining/ipt_actual_all_exp
Viewer
• Updated
• 26.6M • 39
fineinstructions-pretraining/longform_actual_all
Viewer
• Updated
• 27.7k • 12
fineinstructions-pretraining/ipt_fineinstructions_scored
Viewer
• Updated
• 9.93k • 73