From Token Probabilities to Semantic Constraints: Towards Declarative Probabilistic Evaluation of Language Models Paper • 2609.13520 • Published Sep 11
Operadic consistency: a label-free signal for compositional reasoning failures in LLMs Paper • 2606.13649 • Published Jun 11
ArtifactLinker: Linking Scientific Artifacts for Automatic State-of-the-Art Discovery Paper • 2605.16902 • Published May 16 • 1
AstaBench: Rigorous Benchmarking of AI Agents with a Scientific Research Suite Paper • 2510.21652 • Published Oct 24, 2025 • 4
TinyScientist: An Interactive, Extensible, and Controllable Framework for Building Research Agents Paper • 2510.06579 • Published Oct 8, 2025
Analytica: Soft Propositional Reasoning for Robust and Scalable LLM-Driven Analysis Paper • 2604.23072 • Published Apr 24
ZebraLogic: On the Scaling Limits of LLMs for Logical Reasoning Paper • 2502.01100 • Published Feb 3, 2025 • 21
SUPER: Evaluating Agents on Setting Up and Executing Tasks from Research Repositories Paper • 2409.07440 • Published Sep 11, 2024 • 8
The Code2Text Challenge: Text Generation in Source Code Libraries Paper • 1708.00098 • Published Jul 31, 2017
Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research Paper • 2402.00159 • Published Jan 31, 2024 • 67
Learning Semantic Correspondences in Technical Documentation Paper • 1705.04815 • Published May 13, 2017
Text Modular Networks: Learning to Decompose Tasks in the Language of Existing Models Paper • 2009.00751 • Published Sep 1, 2020
Temporal Reasoning on Implicit Events from Distant Supervision Paper • 2010.12753 • Published Oct 24, 2020