| title: README | |
| emoji: 馃實 | |
| colorFrom: purple | |
| colorTo: blue | |
| sdk: static | |
| pinned: false | |
| # OpenSML | |
| **small models. bigger possibilities.** | |
| OpenSML is an independent research lab exploring the full process of building small language models鈥攆rom preparing data and training tokenizers to pretraining, evaluation, and fine-tuning. | |
| We build from scratch on Apple Silicon. Our current training setup connects five Macs for distributed training. | |
| We share model weights, code, and research findings so others can explore, experiment, and build on the work. | |
| **Explore:** [OpenSML-150M](https://huggingface.co/OpenSML/OpenSML-150M) 路 [Website](https://www.open-sml.com/) 路 [Technical report](https://github.com/williamzebrowskI/opensml-150m/blob/main/sml-mlx-v1/docs/TECHNICAL_REPORT.md) | |
| **Contact:** [william.zebrowski@me.com](mailto:william.zebrowski@me.com) | |