Papers
arxiv:2610.40394

Scaling Mathematical Proof Supervision from Structured Textbooks

Published on Oct 29
ยท Submitted by
Fang
on Nov 12
#1 Paper of the day
Authors:
,
,
,
,
,
,
,
,

Abstract

A large-scale corpus of structured proof-supervision records derived from university mathematics textbooks improves language model mathematical reasoning by 16.7 percentage points over a base model when used for fine-tuning.

Mathematical supervision for language models is typically flattened into isolated problem-solution pairs, discarding the curricular organization and evidential structure of the original sources. We introduce TOME-Math (Textbook-Oriented Mathematical Evidence), a large-scale corpus that converts 2,118 textbooks spanning the core areas of university-level mathematics subjects into approximately 380K structured proof-supervision records while preserving chapter order, proposition-proof links, dependency references, and source provenance. Leveraging these structural signals, we explore curriculum learning across multiple mathematical subjects and characterize scaling patterns with supervision volume and source breadth. At full scale, fine-tuning on TOME-Math raises the unweighted mean score across our held-out evaluations and established public benchmarks by 16.7 percentage points over the base model, while exceeding all three public instruction-data baselines evaluated in aggregate. Our findings highlight structured textbooks as both a scalable source of mathematical supervision and an empirical framework for studying the impact of data organization on mathematical reasoning. We will release the corpus to facilitate further research on structured mathematical supervision.

Community

Paper submitter

Introducing TOME-Math, a large-scale mathematical proof supervision corpus built from 2,118 university-level textbooks, containing 380K structured QA records.

Unlike conventional math datasets that flatten knowledge into isolated question-answer pairs, TOME-Math preserves chapter progression, proposition-proof dependencies, and intermediate proof obligations.

๐Ÿš€ Key findings:

  • +16.7 percentage points in average performance across six mathematical reasoning benchmarks.
  • Structured curriculum learning improves reasoning even with the same training data.
  • Demonstrates the value of textbook structure for scalable mathematical supervision.

๐Ÿ”— Project: https://tome-math.github.io/

๐Ÿ“ข The dataset is coming soon, stay tuned!

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2610.40394
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2610.40394 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2610.40394 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2610.40394 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.