OpenSML/OpenSML-150M
Text Generation • 0.2B • Updated
AI & ML interests
Small language models, training from scratch, and distributed training on Apple Silicon.
Recent Activity
Organization Card
OpenSML
small models. bigger possibilities.
OpenSML is an independent research lab exploring the full process of building small language models—from preparing data and training tokenizers to pretraining, evaluation, and fine-tuning.
We build from scratch on Apple Silicon. Our current training setup connects five Macs for distributed training.
We share model weights, code, and research findings so others can explore, experiment, and build on the work.
Explore: OpenSML-150M · Website · Technical report
Contact: william.zebrowski@me.com
datasets 0
None public yet