babylm-macaroni

A GPT-2 model for the BabyLM 2026 Multilingual track. It is trained with our code-switched curriculum corpus. This is our leaderboard submission with full checkpoints. Please see our full set of models for the paper here

Model Sources

The paper, repository, and further details are TBA on release.

Downloads last month
430
Safetensors
Model size
98.4M params
Tensor type
F32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support