kaupane/Inko
Text-to-Image • 0.5B • Updated • 6
Wang Weiyi PRO
kaupane
AI & ML interests
Embodied AI and whatever is fun
Recent Activity
upvoted a paper about 22 hours ago
Loop the Loopies! liked a model about 22 hours ago
zitian-gao/Loopie-20B-A2B-preview reacted to Saccadic-AI's post with 🔥 5 days ago
One neural network. Five mathematical operations. Different learning times.
We trained a small mixture-of-experts transformer on addition, subtraction, multiplication, division, and exponentiation modulo 113.
The operations didn’t generalize together. Multiplication and division reached 90% held-out accuracy first, followed by exponentiation, subtraction, and finally addition.
Multiplication before addition—the reverse of what we expect from a schoolchild.
The accuracy chart in the linked article shows why a single overall accuracy number can hide an interesting learning story.
Measured with IRIS from Saccadic LLC. More figures and analysis: https://huggingface.co/blog/Saccadic-AI/accuracy-plateaued-the-model-kept-changing
Have you observed a similar ordering in multi-task grokking experiments?Organizations
None yet
kaupane/DiT-Wikiart-Large
Text-to-Image • 0.2B • Updated • 8 • 1
kaupane/DiT-Wikiart-Small
Text-to-Image • 22M • Updated • 5
kaupane/DiT-Wikiart-Base
Text-to-Image • 90.3M • Updated • 4
kaupane/ChessFormer-RL
Reinforcement Learning • 0.1B • Updated • 24 • 1
kaupane/ChessFormer-SL
Reinforcement Learning • 0.1B • Updated • 22 • 1