AREX-Base / README.md
cfli's picture
Add files using upload-large-folder tool
9d57012 verified
|
Raw
History Blame Contribute Delete
21.7 kB
metadata
library_name: transformers
license: apache-2.0
pipeline_tag: text-generation
base_model:
  - Qwen/Qwen3.5-122B-A10B
language:
  - en
tags:
  - agent
  - deep-research
  - reasoning
  - tool-use
  - long-context
  - qwen3.5
  - mixture-of-experts
AREX
Towards a Recursively Self-Improving Agent for Deep Research
Paper Homepage Live Demo

Introduction

AREX is a family of deep research agents developed by the Beijing Academy of Artificial Intelligence (BAAI). It is designed for long-horizon tasks in which an agent must search across sources, assemble candidate answers, verify multiple constraints, and revise its research plan when the available evidence is incomplete.

AREX follows a recursive self-improvement framework consisting of an inner research loop and an outer self-improvement loop. The inner loop conducts deep research, while the outer loop evaluates and improves the research process.

This repository contains AREX-Base, the larger model in the AREX family. It is built on Qwen3.5-122B-A10B and uses a Mixture-of-Experts architecture with 122B total parameters and 10B activated parameters.

  • Architecture: Mixture-of-Experts
  • Parameters: 122B
  • Context length: 262,144 tokens

Key Features

  • Recursive self-improvement: evaluates provisional answers and chooses whether to accept, refine, or restart the research trajectory.
  • Verification-guided research: converts unresolved answer constraints into focused follow-up searches.
  • Autonomous context updates: retains verified findings, source identifiers, rejected candidates, open constraints, and the next research plan.
  • Long-horizon tool use: supports multi-round search, browsing, evidence integration, and answer construction.
  • Evidence-grounded answers: maintains supporting evidence and answer-level confidence throughout the research process.

Model Family

Model Backbone Context Positioning
AREX-Base Qwen3.5-122B-A10B 256K Higher-capacity model with the strongest overall AREX results.
AREX-Turbo Qwen3.5-4B 256K Compact model for lower-cost research and tool-use settings.

Method

AREX organizes deep research as two interacting loops supported by autonomous context management.

  1. Inner research loop. The agent searches, reads, integrates evidence, tracks candidates, and produces a provisional answer with supporting evidence and an answer-level confidence score.
  2. Outer self-improvement loop. The agent checks the provisional answer against the original constraints. High-confidence answers are accepted. Recoverable trajectories are refined around unresolved claims, while uninformative trajectories can be restarted.
  3. Autonomous context update. The model invokes update_context to refresh its research state around verified findings, current and rejected candidates, unresolved constraints, source validity, and the next research plan.

This design preserves useful work across iterations and reduces repeated exploration of paths that have already been rejected.

Evaluation

AREX is evaluated through a unified long-horizon search-agent interface with search, visit, update_context, and finish tools. HLE with tools additionally provides a Python tool.

Model Total
Params
BrowseComp GAIA xbench-
2510
DeepSearch
QA
WideSearch-
en
HLE w/
tools
Frontier models
GPT-5.4 -82.7--88.577.552.1*
Opus-4.6 -83.7--91.377.553.0*
Gemini-3.1-Pro -85.980.653.093.366.451.4*
Open-source models
GLM-5 744B75.970.0--69.850.4
Kimi-K2.6 1T83.280.690.092.580.854.0*
DeepSeek-V4-Flash 284B73.2-69.090.676.445.1
DeepSeek-V4-Pro 1.6T83.4-80.088.778.048.2
Tongyi-DeepResearch 30B43.470.955.0--32.9
Qwen3.5-35B 35B61.080.050.368.557.147.4
Qwen3.5-122B 122B63.881.6--60.547.5
Qwen3.5-397B 397B78.683.561.082.174.048.3
MiroThinker-1.7-mini 30B67.980.357.267.9-36.4
MiroThinker-1.7 235B74.082.762.072.1-42.9
MiroThinker-H1 -88.288.572.080.6-47.7
Quest-35B 35B64.680.8--60.637.2
AREX models
AREX-Turbo 4B70.781.657.078.568.540.6
AREX-Base 122B82.585.471.089.982.052.4
* Results reported on the full HLE. Unmarked HLE results use the text-only subset.

Inference

See inference/README.md for OpenAI-compatible serving and generation examples. The folder also contains the complete, directly formattable system and user prompts used for BrowseComp.

Intended Use

AREX-Base is intended for research-agent applications that require long-horizon information seeking, evidence aggregation, multi-constraint verification, and tool-augmented reasoning. Its larger capacity is suited to settings where research quality is prioritized over serving cost.

License

AREX-Base is released under the Apache License 2.0.

Citation

@misc{baai2026arex,
      title={AREX: Towards a Recursively Self-Improving Agent for Deep Research},
      author={Shuqi Lu and Chaofan Li and Kun Luo and Zhang Zhang and Hui Wang and Hongwang Xiao and Lei Xiong and Jiahao Wang and Sen Wang and Xiyan Jiang and Wanli Li and Yuyang Hu and Hongjin Qian and Bingyu Yan and Ziyi Xia and Yingxia Shao and Kang Liu and Zhicheng Dou and Di He and Chaozhuo Li and Qiwei Ye and Zhongyuan Wang and Zheng Liu},
      year={2026},
      eprint={2607.21461},
      archivePrefix={arXiv},
      primaryClass={cs.AI},
      url={https://arxiv.org/abs/2607.21461},
}