Gaia2 Leaderboard Update: New Models and New Observations
• 10
AI & ML interests
None defined yet.
Recent Activity
View all activity
Articles
Post
Weekend mini project! Since commentary on AI is inherently interdisciplinary, we connected the observations in the Pope's encyclical with decades of scholarship in Responsible AI and Ethics research and created an interactive space with these annotations!
Work with @IJ-Reynolds , @yjernite , and @meg
Lots to unpack. We started with 105 annotations. Please submit pull requests for more that we may have missed!
society-ethics/annotated-encyclical
Work with @IJ-Reynolds , @yjernite , and @meg
Lots to unpack. We started with 105 annotations. Please submit pull requests for more that we may have missed!
society-ethics/annotated-encyclical
RomainFroger
updated a
Space 17 days ago
evijit
submitted a
paper to Daily Papers 21 days ago
RomainFroger
published a
dataset about 2 months ago
RomainFroger
updated a
dataset about 2 months ago
clefourrier
authored a
paper 3 months ago
RomainFroger
authored a
paper 3 months ago
mlcu
updated a
Space 4 months ago
mlcu
updated a
Space 6 months ago
Open source traces
3
#2 opened 7 months ago
by 
bhavishya2895
thomwolf
authored a
paper 8 months ago
Post
2876
AI for Scientific Discovery Won't Work Without Fixing How We Collaborate.
My co-author @cgeorgiaw and I just published a paper challenging a core assumption: that the main barriers to AI in science are technical. They're not. They're social.
Key findings:
🚨 The "AI Scientist" myth delays progress: Waiting for AGI devalues human expertise and obscures science's real purpose: cultivating understanding, not just outputs.
📊 Wrong incentives: Datasets have 100x longer impact than models, yet data curation is undervalued.
⚠️ Broken collaboration: Domain scientists want understanding. ML researchers optimize performance. Without shared language, projects fail.
🔍 Fragmentation costs years: Harmonizing just 9 cancer files took 329 hours.
Why this matters: Upstream bottlenecks like efficient PDE solvers could accelerate discovery across multiple sciences. CASP mobilized a community around protein structure, enabling AlphaFold. We need this for dozens of challenges.
Thus, we're launching Hugging Science! A global community addressing these barriers through collaborative challenges, open toolkits, education, and community-owned infrastructure. Please find all the links below!
Paper: AI for Scientific Discovery is a Social Problem (2509.06580)
Join:
hugging-science
Discord: https://discord.com/invite/VYkdEVjJ5J
My co-author @cgeorgiaw and I just published a paper challenging a core assumption: that the main barriers to AI in science are technical. They're not. They're social.
Key findings:
🚨 The "AI Scientist" myth delays progress: Waiting for AGI devalues human expertise and obscures science's real purpose: cultivating understanding, not just outputs.
📊 Wrong incentives: Datasets have 100x longer impact than models, yet data curation is undervalued.
⚠️ Broken collaboration: Domain scientists want understanding. ML researchers optimize performance. Without shared language, projects fail.
🔍 Fragmentation costs years: Harmonizing just 9 cancer files took 329 hours.
Why this matters: Upstream bottlenecks like efficient PDE solvers could accelerate discovery across multiple sciences. CASP mobilized a community around protein structure, enabling AlphaFold. We need this for dozens of challenges.
Thus, we're launching Hugging Science! A global community addressing these barriers through collaborative challenges, open toolkits, education, and community-owned infrastructure. Please find all the links below!
Paper: AI for Scientific Discovery is a Social Problem (2509.06580)
Join:
Discord: https://discord.com/invite/VYkdEVjJ5J
RomainFroger
published an article 8 months ago
Article
Gaia2 Leaderboard Update: New Models and New Observations
meta-agents-research-environments
• • 10Dataset Schema Documentation Misalignment
2
#4 opened 8 months ago
by 
jhamburger-apple
Dataset Schema Documentation Misalignment
2
#4 opened 8 months ago
by jhamburger-apple
mlcu
updated a
dataset 8 months ago
mlcu
authored a
paper 8 months ago
Update task category, paper, code, and project page links for Gaia2 dataset
1
#3 opened 8 months ago
by 
nielsr
mortimerp9
updated a
dataset 8 months ago
GAIA2 only applicable to LLM evaluation not agent scaffold evaluation?
1
#1 opened 8 months ago
by 
pseudotensor