Small language-model ablations trained on FineWeb-Edu, with evaluation confidence intervals and TensorBoard logs.
🤝 Open to Collab
Dmitry Balobin
d0rj
AI & ML interests
NLP and 🥴 tensors.
MIPT PhD student 💙
Recent Activity
updated a collection about 1 hour ago
Tiny llm ablation updated a collection about 1 hour ago
Tiny llm ablation updated a model about 1 hour ago
d0rj/t5-moe-55M-baseOrganizations
Translated into Russian
All datasets have been translated using Google Translate
Collection of Russian instruct data with preferences
Small language-model ablations trained on FineWeb-Edu, with evaluation confidence intervals and TensorBoard logs.
Translated into Russian
into russian
All datasets have been translated using Google Translate
Collected Olympiad and final exam tasks, automatically generated tasks, as well as automatically translated datasets. Work in progress...
Collection of Russian instruct data with preferences