MegaMath - a LLM360 Collection

LLM360 's Collections

K2-V2

Guru

K2-V1

Pebble

Crystal

Amber

MegaMath

updated Jul 3, 2025

MegaMath, the largest open math pre-training dataset curated from diverse, math-focused sources, with over 300B tokens.

LLM360/MegaMath

Viewer • Updated Apr 9, 2025 • 217M • 26.8k • 110
LLM360/MegaMath-Llama-3.2-1B

Text Generation • 1B • Updated Apr 16, 2025 • 5 • 1
LLM360/MegaMath-Llama-3.2-3B

Text Generation • 3B • Updated Apr 16, 2025 • 1 • 5
MegaMath: Pushing the Limits of Open Math Corpora

Paper • 2504.02807 • Published Apr 3, 2025 • 35