โ ~50ร smaller than the 1M-parameter TinyStories model โ ~3,000ร smaller than AlexNet โ 81 KB in FP32
yayyy the whole model. เซฎ หถแต แต แตหถ แ
She has a 32-dimensional hidden state, a 378-token vocabulary, and just one decoder block โ recurrently applied 4 times with shared weights.
Despite having only 19,969 parameters, she can maintain a simple narrative across 100โ300 words: establish a goal, encounter a problem, take relevant actions, and reach an outcome.
She runs extremely fast on CPU โ no GPU required. The entire model is tiny enough to load almost instantly! โบ๏ธ
We will release the BEST SLM Leaderboard before Oct 11.
It will feature everything: Easy to use model picker. EXTREMELY Easy way to add your own models (2 click) MULTIPLE leaderboard for different model types