Research
🔬
10
All research papers, weights, checkpoints, insights and more
Abhay Tyagi
DireDreadlord
AI & ML interests
None yet
Recent Activity
liked a Space about 18 hours ago
SupraLabs/Research-SupraLabs updated a model about 20 hours ago
DireDreadlord/Chaturanga-Nano upvoted a collection 1 day ago
ChaturangaOrganizations
None yet
liked a
Space about 18 hours ago
updated a
model about 20 hours ago
upvoted a collection 1 day ago
updated a
collection 1 day ago
published a
model 1 day ago
liked a
model 6 days ago
upvoted a collection 11 days ago
liked 3
models about 2 months ago
updated a
collection about 2 months ago
updated a
model about 2 months ago
published a
model about 2 months ago
liked a
model 2 months ago
replied to Banaxi-Tech's post 2 months ago
Looking forward to the release!
reacted to Banaxi-Tech's post with 🔥 2 months ago
Post
2862
We're announcing BananaMind 2 Micro, our smallest model in the BananaMind 2 model family.
This model is not released yet, training has not started yet.
It uses only 2.9M parameters, while being overtrained on 75B tokens to get the maximum intelligence per parameter.
The key changes are:
No more AdamW, the model will use the Muon optimizer offering up to 2x faster convergence and higher lr.
LR goes to 2.2e-2.
We're adding the XSA refresh gate from the TX4 architecture into our own.
Training will start on August 3, release date is estimated to be August 4-6.
On August 3 we will also release our Public Preview of BananaMind 2 Pro.
Follow us to know when our models release
BananaMind
@Banaxi-Tech
This model is not released yet, training has not started yet.
It uses only 2.9M parameters, while being overtrained on 75B tokens to get the maximum intelligence per parameter.
The key changes are:
No more AdamW, the model will use the Muon optimizer offering up to 2x faster convergence and higher lr.
LR goes to 2.2e-2.
We're adding the XSA refresh gate from the TX4 architecture into our own.
Training will start on August 3, release date is estimated to be August 4-6.
On August 3 we will also release our Public Preview of BananaMind 2 Pro.
Follow us to know when our models release
@Banaxi-Tech
- 35 replies
liked a
model 3 months ago
updated a
collection 3 months ago
updated 2
models 3 months ago