Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
Banaxi-TechΒ 
posted an update 4 days ago
Post
3,790
KV1 updates:

We at
klein-ml
have finished stage 1 of KV1 1.2B, we don't think we will need additional stages.

KV1 2.6B is near the midpoint of training, going well so far, its going to be our most agentic model yet.

We have released Klein Code Bench klein-ml/klein-code-bench, a benchmark testing whether models can build complete projects from scratch. It contains a easy, intermediate, hard and max subset.


Here are some benchmarks of the current KV1 1.2B


It retains 75.8% of FP16 intelligence.



We are also announcing that we at
klein-ml
are working on Klein 24B A2B which will be our first model featuring ternary weight quantization.

Gotta bencgmark OxCoder and GRM on this πŸ”₯

Congrats on wrapping KV1 1.2B stage 1β€”and the Klein Code Bench release. A reproducible split by difficulty plus model/quantization settings would make the 75.8% FP16-retention figure especially useful; OxCoder and GRM sound like fun stress tests too.