---
license: apache-2.0
---

Model on Wikitext2

Pre-trained a simple model on Wikitext2. No RLHF nothing. 420K parameter model trained on a single RTX 5090