codelion/gpt-2-70m
Text Generation
•
64.1M
•
Updated
•
609
•
18
Pre-training Dataset Samples
A collection of pre-training datasets samples of sizes 10M, 100M and 1B tokens. Ideal for use in quick experimentation and ablations.
-
-
codelion/synth-1B
Viewer • Updated • 822k • 153 -
codelion/dclm-baseline-1B
Viewer • Updated • 774k • 382 • 4 -
codelion/fineweb-edu-1B
Viewer • Updated • 970k • 687 • 6 -
sumukshashidhar-archive/essential-web-v1.0-sample-1B
Viewer • Updated • 1.83M • 205 • 2 -
codelion/finepdfs-1B
Viewer • Updated • 186k • 678 • 3 -
codelion/finewiki-1B
Viewer • Updated • 52.7k • 216 • 2 -
codelion/synth-100M
Viewer • Updated • 100k • 39 -
codelion/dclm-baseline-100M
Viewer • Updated • 77.2k • 58 • 2 -
codelion/fineweb-edu-100M
Viewer • Updated • 115k • 258 • 3 -
sumukshashidhar-archive/essential-web-v1.0-sample-100M
Viewer • Updated • 183k • 47 -
codelion/finepdfs-100M
Viewer • Updated • 18.6k • 36 • 2 -
codelion/finewiki-100M
Viewer • Updated • 68k • 66 • 2 -
codelion/synth-10M
Viewer • Updated • 13.3k • 75 -
codelion/dclm-baseline-10M
Viewer • Updated • 7.95k • 138 • 2 -
codelion/fineweb-edu-10M
Viewer • Updated • 9.46k • 340 • 2 -
sumukshashidhar-archive/essential-web-v1.0-sample-10M
Viewer • Updated • 18.3k • 54 • 1 -
codelion/finepdfs-10M
Viewer • Updated • 7.54k • 145 • 2 -
codelion/finewiki-10M
Viewer • Updated • 4.91k • 1.73k • 2