• 13.9× smaller weight storage than BF16. • 85.9% of BF16’s average score across our 10-task evaluation. • +5.58 average points over binary Bonsai-1.7B in the same evaluation.
It was meant for low-latency tasks using non-thinking and English.
Try it locally in your browser, or download the weights and run on your machine.