togethercomputer/RedPajama-Data-1T
Viewer • Updated • 1.73M • 2.15k • 1.14k
Pretraining Datasets
-
-
EleutherAI/the_pile_deduplicated
Viewer • Updated • 134M • 27.8k • 111 -
karpathy/climbmix-400b-shuffle
Viewer • Updated • 553M • 195k • 32 -
allenai/dolma3_mix-6T
Preview • Updated • 109k • 24 -
Skywork/SkyPile-150B
Viewer • Updated • 1.76M • 33.4k • 404 -
tiiuae/falcon-refinedweb
Viewer • Updated • 968M • 26k • 902 -
allenai/c4
Viewer • Updated • 10.4B • 625k • 540 -
HuggingFaceFW/fineweb
Viewer • Updated • 52.5B • 329k • 2.73k -
PleIAs/common_corpus
Viewer • Updated • 69.9k • 140k • 388 -
bigcode/the-stack-v2
Viewer • Updated • 5.45B • 10k • 526 -
ontocord/MixtureVitae-v1
Viewer • Updated • 59.9M • 1.99k • 15 -
wikimedia/wikipedia
Viewer • Updated • 61.6M • 96.2k • 1.17k -
manu/project_gutenberg
Viewer • Updated • 75.6k • 3.47k • 71 -
KiteFishAI/arxiv-tex-corpus-full
Viewer • Updated • 821k • 687 • 10