Hugging Face's logo

Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
Back to feed
Banaxi-Tech 
posted an update about 23 hours ago
Post
1794
We're announcing our BananaMind 2.1 model series!
The models will include:
- BananaMind 2.1 Nano: 10M parameters with 60B tokens.
- BananaMind 2.1 Lite: 25M parameters with 40B tokens.
- BananaMind 2.1 Flash: 50M parameters with 55B tokens.
- BananaMind 2.1 Pro: 135M-145M parameters (still deciding) with 100B tokens.
These model will use a multi tower architecture (like BananaMind/BananaMind-2.1-Unified) with some more architectural changes.

BananaMind 2.1 Pro will probrably use 2 no output towers, instead of one!

We're currently training some experimental models based on this architecture to see its scaling!

Follow us:
BananaMind
@Banaxi-Tech
@vovaRL
@DedeProGames
bananamind-research-community
Hoglet-33

Can't Wait, I'm so excited!
CNWPlayer

eeee! bananas are so yummy and I bet these benchmark numbers will be too
aquilesfd

this is really interesting!
Datdanboi25

Awesome! More SLM competition!
Bc-AI

@Banaxi-Tech @vovaRL does 250-350M parameters still count as a SLM?

·
Banaxi-Tech

So yeah anything under 1b is slm but open slm leaderboadd allows max of 150m and my leader board allows 250m
AtAndDev

exciting!
In this post