Ai2

non-profit

Verified

https://allenai.org/

AI & ML interests

Building breatkthrough AI to solve the world's biggest problems.

Recent Activity

abhishekraok new activity about 21 hours ago

allenai/Dolci-Think-SFT-32B:Benchmark contamination: MATH test (205 items), ifeval_mt, IFBench, MMLU and GPQA overlap

abhishekraok new activity about 21 hours ago

allenai/Dolci-Think-SFT-7B:Benchmark contamination: MATH test (205 items), ifeval_mt, IFBench, MMLU and GPQA overlap

Ai2Comms published an article 2 days ago

LitPivot: Developing research ideas through dynamic contextualization within the literature landscape

View all activity

Papers

Learning to Solve Hard Problems in RL for LLMs by Never Giving Up

MolmoMotion: Forecasting Point Trajectories in 3D with Language Instruction

View all Papers

Articles

LitPivot: Developing research ideas through dynamic contextualization within the literature landscape

OlmoEarth v1.3: State-of-the-art embeddings for the whole planet

FairStress: A deeper evaluation of fairness in LLM decision-making

HiRO-ACEv2: Simulating extreme weather at 3 km resolution for a fraction of the cost

Impactful scheduling for GPU clusters

Open-sourcing AstaBrief, the fast report-generation model in Asta

Introducing Olmo-core 3: Open, scalable training infrastructure for large MoEs

BenchMIRT: What are LLM benchmarks actually measuring?

Introducing OlmoEarth embeddings: Custom embedding exports from OlmoEarth Studio for downstream analysis

TutorMoments: Do AI tutors know when to help and when to hold back?

The OlmoEarth Platform: Geospatial inference at planetary scale

What building Shippy taught us about building agents

DiScoFormer: One transformer for density and score, across distributions

Which tokens does a hybrid model predict better?

MolmoMotion: Language-guided 3D motion forecasting

olmo-eval: An evaluation workbench for the model development loop

OlmoEarth v1.1: A more efficient family of Earth observation models

EMO: Pretraining mixture of experts for emergent modularity

View all articles

in allenai/Dolci-Think-SFT-32B about 21 hours ago

Benchmark contamination: MATH test (205 items), ifeval_mt, IFBench, MMLU and GPQA overlap

#2 opened about 21 hours ago by

in allenai/Dolci-Think-SFT-7B about 21 hours ago

Benchmark contamination: MATH test (205 items), ifeval_mt, IFBench, MMLU and GPQA overlap

#4 opened about 21 hours ago by

published an article 2 days ago

Article

LitPivot: Developing research ideas through dynamic contextualization within the literature landscape

allenai

•

2 days ago

• 12

in allenai/tulu-3-sft-mixture 3 days ago

Bad samples from Flan V2

#5 opened about 2 months ago by

updated a dataset 3 days ago

allenai/planteur-benchmark

Viewer • Updated 3 days ago • 25 • 680 • 1

in allenai/Dolci-Think-SFT-Olmo-Hybrid-Tool-Use-SA 3 days ago

Data Bug: 2 examples missing 'user' role

#1 opened about 2 months ago by

Remove 2 instances without user turns (DS_576, DS_2946)

#2 opened 3 days ago by

in allenai/Dolci-Think-SFT-7B 3 days ago

changed the text

#3 opened about 2 months ago by

Update README.md

#1 opened 4 months ago by

published an article 3 days ago

Article

OlmoEarth v1.3: State-of-the-art embeddings for the whole planet

allenai

•

3 days ago

• 14

gabrieltsengai2

published a model 4 days ago

allenai/OlmoEarth-v1_3-Base

Image Feature Extraction • Updated 12 days ago • 299 • 13

published a dataset 4 days ago

allenai/planteur-benchmark

Viewer • Updated 3 days ago • 25 • 680 • 1

published an article 5 days ago

Article

FairStress: A deeper evaluation of fairness in LLM decision-making

allenai

•

5 days ago

• 6

published a dataset 5 days ago

allenai/fairstress

Updated 5 days ago • 531 • 6

updated a dataset 5 days ago

allenai/fairstress

Updated 5 days ago • 531 • 6

updated a dataset 7 days ago

allenai/asta-summary-citation-counts

Viewer • Updated 6 days ago • 127M • 1.12k • 12

updated a dataset 10 days ago

allenai/asta-bench-submissions

Updated 10 days ago • 91 • 3

submitted a paper to Daily Papers about 1 month ago

Learning to Solve Hard Problems in RL for LLMs by Never Giving Up

Paper • 2609.13443 • Published Sep 11 • 15

submitted a paper to Daily Papers 3 months ago

Rethinking the Evaluation of Harness Evolution for Agents

Paper • 2607.12227 • Published Jul 14 • 9

authored a paper 4 months ago

REALEDIT: Reddit Edits As a Large-scale Empirical Dataset for Image Transformations

Paper • 2502.03629 • Published Feb 5, 2025 • 2