AI & ML interests

Building breatkthrough AI to solve the world's biggest problems.

Recent Activity

dirkraft  updated a dataset about 3 hours ago
allenai/asta-bench-submissions
rodneyk-allenai  updated a dataset 6 days ago
allenai/asta-bench-results
rodneyk-allenai  updated a dataset 6 days ago
allenai/asta-bench-submissions
View all activity

Articles

allenai 's collections 55

DataDecide
A suite of models, data, and evals over 25 corpora, 14 sizes, and 3 seeds to measure how accurately small experiments predict rankings at large scale.
Tulu V2.5 Suite
A suite of models trained using DPO and PPO across a wide variety (up to 14) of preference datasets. See https://arxiv.org/abs/2406.09279 for more!
OLMo 2 Preview Post-trained Models
These model's tokenizer did not use HF's fast tokenizer, resulting in variations in how pre-tokenization was applied. Resolved in latest versions.
DataDecide
A suite of models, data, and evals over 25 corpora, 14 sizes, and 3 seeds to measure how accurately small experiments predict rankings at large scale.
Tulu V2.5 Suite
A suite of models trained using DPO and PPO across a wide variety (up to 14) of preference datasets. See https://arxiv.org/abs/2406.09279 for more!
OLMo 2 Preview Post-trained Models
These model's tokenizer did not use HF's fast tokenizer, resulting in variations in how pre-tokenization was applied. Resolved in latest versions.