This comment has been hidden
🏗️ Building on HF
AxionLab
AxionLab-official
AI & ML interests
Owner of SupraLabs
Recent Activity
liked a model about 4 hours ago
BananaMind/BananaMind-2.5-Pro liked a model about 15 hours ago
klein-ml/Klein-TTS-X1.5-ProOrganizations
reacted to appvoid's post with ❤️ 4 days ago
Post
7,559
New leaderboard coming to the small language model community!
The leaderboard measures cognitive skills, which is more challenging and beyond language modeling and instruction-following. This is a first step towards more everyday useful and general small models.
dotlabs/cognirank
The leaderboard measures cognitive skills, which is more challenging and beyond language modeling and instruction-following. This is a first step towards more everyday useful and general small models.
dotlabs/cognirank
- 2 replies
reacted to Banaxi-Tech's post with 😔 14 days ago
Post
5,610
BananaMind 3 is going to be an comeback. Sorry for the BGA things ( i genuinely didnt know about nsa existing and yes I used aiiii)
Were going to use our BananaMind 2.1 Unified architecture with some changes + NSA and some other stuff.
Were going to use our BananaMind 2.1 Unified architecture with some changes + NSA and some other stuff.
- 48 replies
reacted to Banaxi-Tech's post with 😔 16 days ago
Post
4,898
BananaMind is in the google situation before argon right now, right?
- 29 replies
reacted to appvoid's post with 🔥 16 days ago
Post
4,006
You know, I can't believe we are actually doing it, literally advancing the frontier at the edge! We've come a long way since the first models on open slm leaderboard, and, as many things that change, performance is one of the main things that has exploded.
7 years ago, the best we had was GPT-2. Today, we got 90m models beating smollm2! I can't barely see what a future with increasingly powerful small models will look like.
All I can say is that the best is yet to come. And will be agentic.
7 years ago, the best we had was GPT-2. Today, we got 90m models beating smollm2! I can't barely see what a future with increasingly powerful small models will look like.
All I can say is that the best is yet to come. And will be agentic.
- 11 replies
reacted to their post with 🚀 21 days ago
reacted to DedeProGames's post with 🧠🚀🔥 25 days ago
Post
3,465
Meet Supra2.5-Ultra-Preview-001. 230M parameters, ~40.4B training tokens.
SupraLabs has released the first preview of its Supra2.5-Ultra family: a compact, Llama-style base model for text completion and small-model experimentation.
What's inside?
• 230M parameters
• 32 transformer layers
• 2,048-token context window
• Grouped Query Attention: 12 attention heads, 4 KV heads
• 49,152-token vocabulary
• SwiGLU activation, RoPE and tied embeddings
• BF16 weights and Hugging Face Transformers support
• Apache 2.0 license
Training
The model was trained on approximately 40.4B tokens from FineWeb-Edu, DCLM-Baseline and FineMath using a single A100 SXM.
Reported zero-shot results
• HellaSwag: 37.18% normalized accuracy
• PIQA: 65.78% accuracy
• ARC-Easy: 57.11% accuracy
• ARC-Challenge: 26.28% normalized accuracy
Want to experiment?
Code on REPO.
Model, weights and usage example:
SupraLabs/Supra2.5-Ultra-Preview-001
SupraLabs has released the first preview of its Supra2.5-Ultra family: a compact, Llama-style base model for text completion and small-model experimentation.
What's inside?
• 230M parameters
• 32 transformer layers
• 2,048-token context window
• Grouped Query Attention: 12 attention heads, 4 KV heads
• 49,152-token vocabulary
• SwiGLU activation, RoPE and tied embeddings
• BF16 weights and Hugging Face Transformers support
• Apache 2.0 license
Training
The model was trained on approximately 40.4B tokens from FineWeb-Edu, DCLM-Baseline and FineMath using a single A100 SXM.
Reported zero-shot results
• HellaSwag: 37.18% normalized accuracy
• PIQA: 65.78% accuracy
• ARC-Easy: 57.11% accuracy
• ARC-Challenge: 26.28% normalized accuracy
Want to experiment?
Code on REPO.
Model, weights and usage example:
SupraLabs/Supra2.5-Ultra-Preview-001
- 4 replies
reacted to mithulaartigala's post with 🔥 26 days ago
replied to DedeProGames's post 26 days ago
Wishing you a strong fresh start with SupraLabs. The focused direction sounds promising—looking forward to seeing what you build next.
You are so cool bro ngl
replied to Banaxi-Tech's post 26 days ago
@LH-Tech-AI @AxionLab-official which model are you talking about?
That BGA shitty thing
replied to Banaxi-Tech's post 27 days ago
If you are going to make the same slop shit you already did, you should stop. Please stop using AI to make AI slop.
reacted to Banaxi-Tech's post with 😔 27 days ago
Post
4,534
Hi everyone, we're back!
And we're releasing something major again now, if you have seen Grok Bot, its very powerful, but there isn't really a local alternative yet.
Today we're releasing Minds, they're personal AI bots that live on your computer.
They can run anywhere, on your phone, on your mac, on windows, and even on linux.
They support OpenAI Oauth as the main integration because most people already have a ChatGPT sub.
But locally, It supports ANY openai compatible api which allows you to setup ollama and llama.cpp and everything else.
It uses Jev for command approval on OpenRouter and Muse Spark Transcribe for transcription.
Its fully Open Source!
Check it out: https://github.com/BananaMind/Minds
And we're releasing something major again now, if you have seen Grok Bot, its very powerful, but there isn't really a local alternative yet.
Today we're releasing Minds, they're personal AI bots that live on your computer.
They can run anywhere, on your phone, on your mac, on windows, and even on linux.
They support OpenAI Oauth as the main integration because most people already have a ChatGPT sub.
But locally, It supports ANY openai compatible api which allows you to setup ollama and llama.cpp and everything else.
It uses Jev for command approval on OpenRouter and Muse Spark Transcribe for transcription.
Its fully Open Source!
Check it out: https://github.com/BananaMind/Minds
- 9 replies
reacted to DedeProGames's post with 🔥🚀🤗❤️ 28 days ago
Post
5,149
I’ve just left 
BananaMind to focus my work on SupraLabs .
Following some internal pressure from SupraLabs and issues @Banaxi-Tech encountered with certain architectures, I decided it was time to change direction.
I want to thank BananaMind for inviting me to join their organization and for helping shape my knowledge and passion regarding SLMs.
Now, it’s just me and SupraLabs .
Following some internal pressure from SupraLabs and issues @Banaxi-Tech encountered with certain architectures, I decided it was time to change direction.
I want to thank
Now, it’s just me and
- 8 replies
replied to Banaxi-Tech's post 29 days ago
Bananamind3 is getting delayed lmao
reacted to Banaxi-Tech's post with 😔 29 days ago
Post
3,231
We have released BGA!
And wow, It provides 256x (and 512x at the end of 1M) yes 256x LESS attention compute at 1M context window.
That means you can train a 1M context window at the compute of a ~4K context window.
Check IT OUT: BananaMind/blog
The Accuracy Should BE WAy better than DSA but untested yet.
And, now some updates on BananaMind 3:
BananaMind 3 Will start training Soon!
Sizes: 10M, 25M, 50M, 100M, 150M
And the context windows ARE INSANE: 10M, 16K context, 25M 16k context, 50M 32K context, 100M and 150M, 64K context!!!!
And wow, It provides 256x (and 512x at the end of 1M) yes 256x LESS attention compute at 1M context window.
That means you can train a 1M context window at the compute of a ~4K context window.
Check IT OUT: BananaMind/blog
The Accuracy Should BE WAy better than DSA but untested yet.
And, now some updates on BananaMind 3:
BananaMind 3 Will start training Soon!
Sizes: 10M, 25M, 50M, 100M, 150M
And the context windows ARE INSANE: 10M, 16K context, 25M 16k context, 50M 32K context, 100M and 150M, 64K context!!!!
- 13 replies