Small Language Model Consortium

community

Activity Feed

AI & ML interests

Consortium for the continued development of Small Language Models

Recent Activity

ArushCodes new activity about 1 hour ago

slmconsortium/README:I wanna add my main account too

KlondikeDev new activity about 1 hour ago

slmconsortium/README:I wanna add my main account too

ArushCodes new activity about 1 hour ago

slmconsortium/README:I wanna join

View all activity

ArushCodes

in slmconsortium/README about 1 hour ago

I wanna add my main account too

#12 opened about 1 hour ago by

ArushCodes

KlondikeDev

in slmconsortium/README about 1 hour ago

I wanna add my main account too

#12 opened about 1 hour ago by

ArushCodes

in slmconsortium/README about 1 hour ago

I wanna join

#11 opened about 1 hour ago by

ArushCodes

KlondikeDev

in slmconsortium/README about 1 hour ago

I wanna join

#11 opened about 1 hour ago by

ArushCodes

Banaxi-Tech

posted an update 1 day ago

Post

2185

Hi everyone, we're back!

And we're releasing something major again now, if you have seen Grok Bot, its very powerful, but there isn't really a local alternative yet.

Today we're releasing Minds, they're personal AI bots that live on your computer.
They can run anywhere, on your phone, on your mac, on windows, and even on linux.

They support OpenAI Oauth as the main integration because most people already have a ChatGPT sub.

But locally, It supports ANY openai compatible api which allows you to setup ollama and llama.cpp and everything else.

It uses Jev for command approval on OpenRouter and Muse Spark Transcribe for transcription.

Its fully Open Source!

Check it out: https://github.com/BananaMind/Minds

9 replies

AtAndDev

posted an update 2 days ago

Post

4861

@Banaxi-Tech stop hiding my comments. AND STOP STEALING PAPERS AND SPREADING MISINFORMATION.
your BGA blog is a copy of NSA (deepseek, 2025) branded under your name. literally the same top16 selected blocks, 512 local window, router over block summaries, all you did was change block size from 64 to 128.
you didnt cite NSA once but you put a “please cite BGA” bibtex at the bottom.
i commented under your post and said that there is no way that you can support claims like: “The Accuracy Should BE WAy better than DSA but untested yet.” you didnt run a single experiment. and the 256x isnt from BGA, its just n/2k with k=2048 so the exact same k DSA uses. if opus wrote this for you, at least read it before posting.
i commented again after you hid my comment despite it having constructive and correct feedback and you hid that too. and again.
you can hide the truth and just try to get hf post likes..... but is it really the thing that needs to be done? do you really want to take papers and make them yours while barely even changing the params?

admitting your mistakes and doing something about them needs humbleness, intelligence, humanness.
i encourage you to admit your mistakes and try to do better next time (at least read what blog your ai wrote or do proper experiments to back your stuff up).

49 replies

Banaxi-Tech

posted an update 2 days ago

Post

4630

Well GPT X3 takes the lead. As of right now.

We are now announcing BananaMind 3 🍌! (not ai for those emoji guys)

All models will use BGA (which is almost just NSA) and our BM3X architecture.
Its sizes will be:
BananaMind 3 Flash Lite, 3M parameters at a context of 8K context.
BananaMind 3 Lite, 10M parameters with 16K context.
BananaMind 3 Flash, 25M Parameters with 16K context.
BananaMind 3 Pro, 50M parameters with 24K context.
BananaMind 3 Ultra, 100M parameters with 32K context.
And lastly, BananaMind 3 Max with 150M parameters and 64K CONTEXT.

I can assure you BananaMind 3 Max WILL beat GPT X3 or match it, we won't release it otherwise. We hope for a 40+ INTELLIGENCE INDEX!

BananaMind 3 may also be partnered with dot labs.

We will cancel BananaMind 2.1 and BananaMind 2 Ultra.

As of the BETU SLM Leaderboard we may need to release it after October 11, im very busy right now (even though we said We will release BETU leaderboard before Oct 11 😟)

11 replies

Banaxi-Tech

posted an update 3 days ago

Post

3191

We have released BGA!
And wow, It provides 256x (and 512x at the end of 1M) yes 256x LESS attention compute at 1M context window.
That means you can train a 1M context window at the compute of a ~4K context window.

Check IT OUT: BananaMind/blog

The Accuracy Should BE WAy better than DSA but untested yet.

And, now some updates on BananaMind 3:

BananaMind 3 Will start training Soon!
Sizes: 10M, 25M, 50M, 100M, 150M

And the context windows ARE INSANE: 10M, 16K context, 25M 16k context, 50M 32K context, 100M and 150M, 64K context!!!!

13 replies

Banaxi-Tech

posted an update 4 days ago

Post

129

Hi! We're right now experimenting with so many new architectures!

We are also going to release BananaMind Gate Attention very soon, its a new attention that can make attention 128x cheaper at 1M Context! Check my account for HF blogs it will release there!

Banaxi-Tech

posted an update 5 days ago

Post

We're introducing ACR 1.0.
We trained this model on a 5070 Ti for weeks, here are some of the architecture details:
57M parameters, with one M and one G stream.
When we tested it on benchmarks, we got these results:
Benchmark Full G-Only Delta
PIQA 62.24% 53.43% +8.81
ARC-Easy 41.96% 32.28% +9.68
HellaSwag 33.19% 29.08% +4.11
Tiny ToM 40.65% 33.75% +6.90
ArithMark 3.0 33.40% 32.80% +0.60
Base Bench 1.1 51.71% 40.29% +11.42

Check it out at saicr/ACR-1.0

3 replies

Banaxi-Tech

posted an update 6 days ago

Post

165

Its SAICR time tomorrow.
Get ready!

saicr

28 replies

Banaxi-Tech

posted an update 7 days ago

Post

3063

We will release the BEST SLM Leaderboard before Oct 11.

It will feature everything:
Easy to use model picker.
EXTREMELY Easy way to add your own models (2 click)
MULTIPLE leaderboard for different model types

And more!

So why don't you help us build it?

Join