Post
58
We're announcing Klein Ternary 1.7B.
Its our latest, ternary-weight model based on LFM 3 1.7B. Our target is 80-85% top 1 alignment, putting it close to 4 bit.
Klein Ternary is aimed at coding, with a footprint under 1 GB. It’s best suited for Raspberry Pis, phones and other low-power devices where even 4-bit models are too heavy.
The training pipeline is, normal self distillation, with a small seperate stage to bring out more coding performance after, and then a bit of post-training on Qwen distilled data to make it better.
We plan to release it in about 10 days.
Its our latest, ternary-weight model based on LFM 3 1.7B. Our target is 80-85% top 1 alignment, putting it close to 4 bit.
Klein Ternary is aimed at coding, with a footprint under 1 GB. It’s best suited for Raspberry Pis, phones and other low-power devices where even 4-bit models are too heavy.
The training pipeline is, normal self distillation, with a small seperate stage to bring out more coding performance after, and then a bit of post-training on Qwen distilled data to make it better.
We plan to release it in about 10 days.