allenai/MADLAD-400
Updated • 14.6k • 172
text-pretrain-data
some pretrain dataset for LLM
-
-
CASIA-LM/ChineseWebText
Viewer • Updated • 1k • 5.2k • 45 -
allenai/dolma
Updated • 2.69k • 1.07k -
allenai/peS2o
Updated • 12.2k • 201 -
Skywork/SkyPile-150B
Viewer • Updated • 1.76M • 20.1k • 408 -
wenge-research/yayi2_pretrain_data
Viewer • Updated • 1.68M • 1.64k • 60 -
togethercomputer/RedPajama-Data-V2
Updated • 4.79k • 405 -
tiiuae/falcon-refinedweb
Viewer • Updated • 968M • 90.8k • 947 -
togethercomputer/RedPajama-Data-1T
Updated • 1.84k • 1.19k -
Tele-AI/TeleChat-PTD
Updated • 838 • 177 -
open-web-math/open-web-math
Viewer • Updated • 6.32M • 32.9k • 357 -
GAIR/MathPile
Preview • Updated • 750 • 196 -
EleutherAI/proof-pile-2
Updated • 11.7k • 231 -
vietgpt/open-web-math
Viewer • Updated • 6.32M • 167 -
meta-math/MetaMathQA
Viewer • Updated • 395k • 63k • 467 -
bigcode/the-stack-dedup
Viewer • Updated • 237M • 21.8k • 400 -
bigcode/the-stack
Viewer • Updated • 471M • 14.1k • 1.06k -
nampdn-ai/tiny-strange-textbooks
Viewer • Updated • 1M • 170 • 94 -
uonlp/CulturaX
Viewer • Updated • 7.18B • 14.3k • 664 -
Locutusque/UltraTextbooks
Viewer • Updated • 5.52M • 498 • 201 -
HuggingFaceTB/cosmopedia
Viewer • Updated • 31.1M • 22.2k • 739