Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
Banaxi-Tech 
posted an update about 14 hours ago
Post
58
We're announcing Klein Ternary 1.7B.

Its our latest, ternary-weight model based on LFM 3 1.7B. Our target is 80-85% top 1 alignment, putting it close to 4 bit.

Klein Ternary is aimed at coding, with a footprint under 1 GB. It’s best suited for Raspberry Pis, phones and other low-power devices where even 4-bit models are too heavy.

The training pipeline is, normal self distillation, with a small seperate stage to bring out more coding performance after, and then a bit of post-training on Qwen distilled data to make it better.

We plan to release it in about 10 days.

•
This comment has been hidden
In this post