Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
rain2sun 's Collections
mBase LLM
Benchmark
NLP
RL-Datasets
Distilled
Math-Code-Reason
Code-IFT-Datasets
Open-LLM
High-Quality-Datasets
Pretrain-Datasets
IFT-Datasets

Pretrain-Datasets

updated Jun 9, 2025

预训练使用的超大规模开源数据集

Upvote
-

  • togethercomputer/RedPajama-Data-V2

    Updated Nov 21, 2024 • 2.22k • 394

  • bigcode/the-stack-v2

    Viewer • Updated Apr 23, 2024 • 5.45B • 8.02k • 461

  • mlfoundations/dclm-baseline-1.0

    Preview • Updated Jul 22, 2024 • 116k • 252

  • LLM360/TxT360

    Updated May 26, 2025 • 26.1k • 248

  • opencsg/chinese-fineweb-edu-v2

    Viewer • Updated Dec 12, 2025 • 188M • 2.88k • 72

  • HuggingFaceFW/fineweb-edu

    Viewer • Updated Jul 11, 2025 • 3.5B • 289k • 939

  • bigcode/the-stack-dedup

    Viewer • Updated Aug 17, 2023 • 237M • 19.9k • 382

  • HuggingFaceFW/fineweb-2

    Viewer • Updated Oct 27, 2025 • 4.48B • 102k • 746

  • microsoft/RedStone

    Updated Dec 5, 2024 • 17 • 35

  • CASIA-LM/ChineseWebText2.0

    Viewer • Updated Dec 2, 2024 • 2k • 3.3k • 28

  • openbmb/Ultra-FineWeb

    Viewer • Updated Dec 10, 2025 • 1.29B • 39.2k • 306
Upvote
-
  • Collection guide
  • Browse collections
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs