Zyphra/Zyda-2
Preview
•
Updated
•
144k
•
85
Interesting Pre-Training Datasets
Note Look at the preprocessing code: https://github.com/Zyphra/Zyda_processing
-
HuggingFaceTB/dclm-edu
Viewer • Updated • 1B • 2.69k • 30 -
HuggingFaceFW/fineweb-edu
Viewer • Updated • 3.5B • 310k • 907 -
HuggingFaceTB/stack-edu
Viewer • Updated • 167M • 2.32k • 63 -
HuggingFaceTB/finemath
Viewer • Updated • 48.3M • 8.59k • 348 -
bigcode/the-stack
Viewer • Updated • 546M • 14.8k • 910 -
bigcode/the-stack-v2
Viewer • Updated • 5.45B • 5.17k • 443 -
HuggingFaceTB/smollm-corpus
Viewer • Updated • 237M • 20.8k • 415 -
mlfoundations/dclm-baseline-1.0
Preview • Updated • 564k • 251 -
HuggingFaceFW/fineweb-2
Viewer • Updated • 4.48B • 99k • 717