---
license: mit
tags:
- proto-mini
- early
- experimental
- open-source
- open
- source
- model
- experimental-use
---
![Proto mini random image for style, idk why just why not](proto.png)
## Proto Mini - Random models that output text
Proto-mini are small GGUF files that output text - without needing to be trained on huge corpus'.
Via lite pretraining - random init - and more, we have achieved quality that beats init models.
If you cpt on these GGUF's via Unsloth Studio, you get sequence level text generations.

It reaches speeds on 640 tok/s on the content in init.txt, random tokens with c at the start.

It already has the vocab - it just needs to know what to use.