metadata
license: mit
tags:
- proto-mini
- early
- experimental
- open-source
- open
- source
- model
- experimental-use
Proto Mini - Random models that output text
Proto-mini are small GGUF files that output text - without needing to be trained on huge corpus'. Via lite pretraining - random init - and more, we have achieved quality that beats init models. If you cpt on these GGUF's via Unsloth Studio, you get sequence level text generations.
It reaches speeds on 640 tok/s on the content in init.txt, random tokens with c at the start.
It already has the vocab - it just needs to know what to use.