metadata
title: README
emoji: 🌍
colorFrom: purple
colorTo: blue
sdk: static
pinned: false
OpenSML
small models. bigger possibilities.
OpenSML is an independent research lab exploring the full process of building small language models—from preparing data and training tokenizers to pretraining, evaluation, and fine-tuning.
We build from scratch on Apple Silicon. Our current training setup connects five Macs for distributed training.
We share model weights, code, and research findings so others can explore, experiment, and build on the work.
Explore: OpenSML-150M · Website · Technical report
Contact: william.zebrowski@me.com