Training sources: Wikimedia Wikipedia, HuggingFaceFW FineWeb2 and FineWeb-Edu, HPLT 2.0, OpenWebMath and CodeParrot GitHub Code. See README.md for pinned source cards. The FineWeb2, FineWeb-Edu and OpenWebMath databases use ODC-By 1.0 (https://opendatacommons.org/licenses/by/1-0/). Wikimedia credits appear in the page histories. HPLT applies CC0 to the packaging. GitHub Code records upstream repository license labels. The release contains model weights, tokenizer assets, and inference documentation.