How to use from the
Use from the
Transformers library
# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="drooryck/babylm-macaroni")
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("drooryck/babylm-macaroni")
model = AutoModelForCausalLM.from_pretrained("drooryck/babylm-macaroni", device_map="auto")
Quick Links

babylm-macaroni

A GPT-2 model for the BabyLM 2026 Multilingual track. It is trained with our code-switched curriculum corpus. This is our leaderboard submission with full checkpoints. Please see our full set of models for the paper here

Model Sources

The paper, repository, and further details are TBA on release.

Downloads last month
453
Safetensors
Model size
98.4M params
Tensor type
F32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support