Papers
arxiv:2611.03233

Axion 1.0: Open Agent Foundation Models, Simplified

Published on Nov 2
· Submitted by
Yuqi Jia
on Nov 4
Authors:
,
,
,
,
,
,

Abstract

Axion 1.0 is an open agent foundation model trained via a concise three-stage pipeline of supervised fine-tuning and reinforcement learning, achieving competitive agentic performance while fully releasing its data and training recipe.

We introduce Axion 1.0, a fully open agent foundation model that combines strong and broad agentic capabilities with a remarkably simple training recipe. Axion 1.0 is trained in only three stages: two lightweight supervised fine-tuning stages followed by reinforcement learning, without dedicated mid-training, direct preference optimization (DPO), or on-policy distillation (OPD). The first SFT stage develops strong self-contained reasoning through model-aware data construction, where we synthesize challenging problems and adversarially strengthen them based on the base model's own successful solution strategies. The second stage extends these capabilities to tool-dependent reasoning through a scalable pipeline for constructing diverse and automatically verifiable tasks grounded in real-world data sources and deterministic computation. Finally, reinforcement learning further strengthens long-horizon reasoning and interaction with external tools and environments. Despite this compact training recipe, Axion 1.0 achieves strong performance across a broad suite of agentic benchmarks and is competitive with leading commercial models on several of them. Equally importantly, Axion 1.0 is open beyond model weights: we release the complete recipe, including data construction, generation, filtering, verification, prompts, and training code, enabling the entire development process to be reproduced and extended. Axion 1.0 demonstrates that strong agent foundation models can be both open and simple, offering a practical and reproducible path toward advancing open agentic intelligence.

Community

Paper submitter

Introducing Axion 1.0: Open Agent Foundation Models, Simplified.

Strong scientific reasoning and tool use with a simple post-training recipe: two lightweight supervised fine-tuning stages followed by reinforcement learning.

  • Learn to reason: model-aware construction of challenging, self-contained scientific problems.
  • Learn to investigate: verifiable tasks that require retrieving information and using tools.
  • Learn through interaction: reinforcement learning over agent trajectories.

With approximately 18K SFT examples, Axion 1.0-35B and 122B achieve competitive results across six evaluation settings: HLE, BioMysteryBench, SEAL-0, HiPhO, and the Olympiad and Research splits of FrontierScience.

The Axion 1.0-35B reproduction checkpoint is now available under Apache 2.0. It scores 52.8 on HLE, 35.3 on BioMysteryBench, 60.4 on SEAL-0, 45.9 on HiPhO, 85.0 on FrontierScience Olympiad, and 55.0 on FrontierScience Research.

Paper: https://arxiv.org/abs/2611.03233
Project: https://axion1-0.github.io/
Code: https://github.com/bytedance/axion1_0
Training data: https://huggingface.co/datasets/Axion1-0/axion-training-data
Model (35B reproduction): https://huggingface.co/Axion1-0/Axion-1.0-35B

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2611.03233
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 1

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2611.03233 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2611.03233 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.