AI & ML interests

A public archive of decoder-only models where anyone can archive their own models.

Recent Activity

Banaxi-Techย 
posted an update 1 day ago
view post
Post
84
We're announcing Klein Ternary 1.7B.

Its our latest, ternary-weight model based on LFM 3 1.7B. Our target is 80-85% top 1 alignment, putting it close to 4 bit.

Klein Ternary is aimed at coding, with a footprint under 1 GB. Itโ€™s best suited for Raspberry Pis, phones and other low-power devices where even 4-bit models are too heavy.

The training pipeline is, normal self distillation, with a small seperate stage to bring out more coding performance after, and then a bit of post-training on Qwen distilled data to make it better.

We plan to release it in about 10 days.

GGUFGuyย 
updated a Space 3 days ago
Banaxi-Techย 
posted an update 6 days ago
view post
Post
6,632
We're introducing KV1 1.2B.
Its our first KV1 model using a 2 bit KV cache, based on LFM 2.5 1.2B.

KV1 1.2B retains 75.8% of original intelligence.

More details: klein-ml/blog

Model klein-ml/KV1-1.2B
  • 5 replies
ยท
DedeProGamesย 
posted an update 6 days ago
view post
Post
5,283
We are working on LFM3-1.7B-Ox, a compact model for repo-level programming, agentic coding, and tinkering.
  • 3 replies
ยท
Banaxi-Techย 
posted an update 7 days ago
view post
Post
6,359
BananaMind 3 is coming.

Biggest context in all SLMs with NSA.
10M, 50M, 150M, 400M.

And maybe, 1B.
  • 14 replies
ยท
Banaxi-Techย 
posted an update 8 days ago
view post
Post
6,706
We've released the BananaMind/BETU-SLM-Leaderboard

Its so simple to use, it ranks models, and by one command add your own model to it.

It scores by Overall Index which is a weighted mix of Hellaswawg, ARC EASY, PIQA, Arithmark 3, Tiny Theory of Mind, and BananaMind Base Bench.
  • 1 reply
ยท
Banaxi-Techย 
posted an update 9 days ago
view post
Post
106
We ARE Announcing BananaMind 3 Ultra.

400M parameters, designed to beat LFM 2.5 1.2B.

This model is a usable small agent. Not a demo model like our 3M models.


FP8. KV1. Optimization. FactBase DCLM. Fable 5.2 for maximum speed kernels. TST.

This model will M.
What do you think? 50+ INT Index on the Open SLM leaderboard? BananaMind 3 is coming before christmas.

  • 11 replies
ยท
XBFDIย 
posted an update 9 days ago
view post
Post
32
uglyfacegenerate... What the fu
Banaxi-Techย 
posted an update 12 days ago
Banaxi-Techย 
posted an update 13 days ago
view post
Post
71
Hi guys.

We're announcing Klein SL Pro, our new model at Klein ML.
It's doing post-training of Qwen3.8 Flash Next to make IT fit on 16GB VRAM.

It works by converting its MoE to SLMoE, SLMoE is an architecture, that chooses experts per response, not per token anymore.

This makes it so you can offload everything else to the disk and not get slow speed.


We're also seeking more compute to do this same thing on Deepseek V4.1 Flash, allowing it to run on 16GB VRAM tightly and definitely on 24GB. If you have hardware, more than 200B of VRAM in total, create a discussion klein-ml/README.
  • 2 replies
ยท
XBFDIย 
posted an update 13 days ago
view post
Post
64
hi im back
  • 1 reply
ยท
GGUFGuyย 
posted an update 14 days ago
view post
Post
98
so uhh guys do y'all want Novi mini first or HyperSLM first?
  • 3 replies
ยท
GGUFGuyย 
posted an update 16 days ago
view post
Post
144
ok FINALLY i can post again.
  • 2 replies
ยท
Banaxi-Techย 
posted an update 17 days ago
Banaxi-Techย 
posted an update 19 days ago
view post
Post
136
SupraTTS is going to be cooked lol

Klein TTS X1.5 is releasing in under a WEEK


(supratts scoring 743 on tts index: ๐Ÿ˜ญ)


we are just doing our post training now before releasing and are so excited with the results x2 will be insane!
  • 19 replies
ยท
Banaxi-Techย 
posted an update 20 days ago
view post
Post
115
Happy halloween everyone!


We've did some updates to Banaxi-Tech/TTS-Arena and now, everyone who uses the TTS Arena alot will get featured in our Klein TTS Release. Using it REALLY helps us alot so please use it.

Updates on the sizes: Klein TTS Flash Lite with 0.4M parameters, Klein TTS Flash with 1.7M parameters, Klein TTS Pro with 13M parameters and Ultra with 21M.
DedeProGamesย 
posted an update 21 days ago
view post
Post
3,219
Hi everyone! I want to share a few updates about GRM development.

*GRM-3.4 has been canceled*

Although GRM-3.4 showed strong reasoning and coding capabilities, testing revealed several issues. It tended to overthink, and its code often contained errors that GRM-3.2-Sky handled correctly. Its tool use also needed improvement, and its terminal performance did not reach the level we were aiming for.

We repeatedly saw it rewrite files from scratch instead of using editing tools, and use shell commands to create or modify files when dedicated tools were available.

*Looking ahead to GRM-3.6*

GRM-3.6 is a possible next generation for the GRM models. We are still deciding whether it will be a single large model or a complete model family. The flagship is set to be **GRM-3.6-Moon**, a **35B-A3B** model.

*Experimental models*

Orion LLM Labs may release experimental models more regularly from now on. These experiments will help us research and test ideas for future GRM models.

Thanks for following the project!
  • 3 replies
ยท
Banaxi-Techย 
posted an update 23 days ago
view post
Post
92
Hi everyone, we're releasing the TTS Arena.

You can test models and see rankings, its like the SLM Arena but for TTS.

Right now there are 2 stealth models on the arena, "cirxinx" and "tiger-alpha", try them out to preview a new model ๐Ÿฅท


We're also training Klein TTS X1.5 right now, they will release soon. We're also adding a 210K parameter size.


If your excited on them vote here: Banaxi-Tech/HuggingPolls

If you'r wondering what that is, its HuggingPolls, a space we released for Polls on huggingface.

Because huggingface doesent have any polls, we made it.

You can also make your own polls!
  • 1 reply
ยท
Hoglet-33ย 
posted an update 23 days ago
view post
Post
3,966
I wish Hugging Face posts had polls...
  • 6 replies
ยท
Banaxi-Techย 
posted an update 24 days ago
view post
Post
109
Klein TTS X1.5!!!


It will feature 1.7M,4M 13M and a 21M size

klein-ml


Early access opening soon
Its training right now!

We are also working on the X2 architecture featuring a feature that allows the model to iterate on the audio it produced.