Article
Extreme Overtraining in Tiny Language Models
Banaxi-Tech
• • 9
Marcos
mvircs
·
AI & ML interests
None yet
Recent Activity
upvoted an article 8 days ago
Extreme Overtraining in Tiny Language Models commentedon an article 8 days ago
Extreme Overtraining in Tiny Language Models liked a Space 10 days ago
BananaMind/BananaMindBench-LeaderboardOrganizations
upvoted an article 8 days ago
commented on Extreme Overtraining in Tiny Language Models 8 days ago
Interesting.
When I test my models, a 40:1 scale always seems to be the most suitable; if it's higher or lower than that, the model's performance suffers.
liked a
Space 10 days ago
liked a
dataset 10 days ago
Nemotron-CC-Math > Fine-Math
1
#2 opened 14 days ago
by mvircs