--- library_name: transformers license: apache-2.0 pipeline_tag: text-generation base_model: - Qwen/Qwen3.5-122B-A10B language: - en tags: - agent - deep-research - reasoning - tool-use - long-context - qwen3.5 - mixture-of-experts ---
AREX
Towards a Recursively Self-Improving Agent for Deep Research
Paper Homepage Live Demo
## Introduction AREX is a family of deep research agents developed by the Beijing Academy of Artificial Intelligence (BAAI). It is designed for long-horizon tasks in which an agent must search across sources, assemble candidate answers, verify multiple constraints, and revise its research plan when the available evidence is incomplete. AREX follows a recursive self-improvement framework consisting of an inner research loop and an outer self-improvement loop. The inner loop conducts deep research, while the outer loop evaluates and improves the research process. This repository contains **AREX-Base**, the larger model in the AREX family. It is built on Qwen3.5-122B-A10B and uses a Mixture-of-Experts architecture with 122B total parameters and 10B activated parameters. - **Architecture:** Mixture-of-Experts - **Parameters:** 122B - **Context length:** 262,144 tokens **Key Features** - **Recursive self-improvement:** evaluates provisional answers and chooses whether to accept, refine, or restart the research trajectory. - **Verification-guided research:** converts unresolved answer constraints into focused follow-up searches. - **Autonomous context updates:** retains verified findings, source identifiers, rejected candidates, open constraints, and the next research plan. - **Long-horizon tool use:** supports multi-round search, browsing, evidence integration, and answer construction. - **Evidence-grounded answers:** maintains supporting evidence and answer-level confidence throughout the research process. **Model Family** | Model | Backbone | Context | Positioning | | --- | --- | ---: | --- | | [AREX-Base](https://huggingface.co/BAAI/AREX-Base) | Qwen3.5-122B-A10B | 256K | Higher-capacity model with the strongest overall AREX results. | | [AREX-Turbo](https://huggingface.co/BAAI/AREX-Turbo) | Qwen3.5-4B | 256K | Compact model for lower-cost research and tool-use settings. | ## Method AREX organizes deep research as two interacting loops supported by autonomous context management. 1. **Inner research loop.** The agent searches, reads, integrates evidence, tracks candidates, and produces a provisional answer with supporting evidence and an answer-level confidence score. 2. **Outer self-improvement loop.** The agent checks the provisional answer against the original constraints. High-confidence answers are accepted. Recoverable trajectories are refined around unresolved claims, while uninformative trajectories can be restarted. 3. **Autonomous context update.** The model invokes `update_context` to refresh its research state around verified findings, current and rejected candidates, unresolved constraints, source validity, and the next research plan. This design preserves useful work across iterations and reduces repeated exploration of paths that have already been rejected. ## Evaluation AREX is evaluated through a unified long-horizon search-agent interface with `search`, `visit`, `update_context`, and `finish` tools. HLE with tools additionally provides a Python tool.
Model Total
Params		 BrowseComp GAIA xbench-
2510		 DeepSearch
QA		 WideSearch-
en		 HLE w/
tools
Frontier models
GPT-5.4 -82.7--88.577.552.1*
Opus-4.6 -83.7--91.377.553.0*
Gemini-3.1-Pro -85.980.653.093.366.451.4*
Open-source models
GLM-5 744B75.970.0--69.850.4
Kimi-K2.6 1T83.280.690.092.580.854.0*
DeepSeek-V4-Flash 284B73.2-69.090.676.445.1
DeepSeek-V4-Pro 1.6T83.4-80.088.778.048.2
Tongyi-DeepResearch 30B43.470.955.0--32.9
Qwen3.5-35B 35B61.080.050.368.557.147.4
Qwen3.5-122B 122B63.881.6--60.547.5
Qwen3.5-397B 397B78.683.561.082.174.048.3
MiroThinker-1.7-mini 30B67.980.357.267.9-36.4
MiroThinker-1.7 235B74.082.762.072.1-42.9
MiroThinker-H1 -88.288.572.080.6-47.7
Quest-35B 35B64.680.8--60.637.2
AREX models
AREX-Turbo 4B70.781.657.078.568.540.6
AREX-Base 122B82.585.471.089.982.052.4
* Results reported on the full HLE. Unmarked HLE results use the text-only subset.
## Inference See [`inference/README.md`](inference/README.md) for OpenAI-compatible serving and generation examples. The folder also contains the complete, directly formattable system and user prompts used for BrowseComp. ## Intended Use AREX-Base is intended for research-agent applications that require long-horizon information seeking, evidence aggregation, multi-constraint verification, and tool-augmented reasoning. Its larger capacity is suited to settings where research quality is prioritized over serving cost. ## License AREX-Base is released under the [Apache License 2.0](LICENSE). ## Citation ```bibtex @misc{lu2026arexrecursivelyselfimprovingagent, title={AREX: Towards a Recursively Self-Improving Agent for Deep Research}, author={Shuqi Lu and Chaofan Li and Kun Luo and Zhang Zhang and Hui Wang and Hongwang Xiao and Zheng Liu and Lei Xiong and Jiahao Wang and Sen Wang and Xiyan Jiang and Wanli Li and Yuyang Hu and Hongjin Qian and Bingyu Yan and Ziyi Xia and Yingxia Shao and Kang Liu and Zhicheng Dou and Di He and Chaozhuo Li and Qiwei Ye and Zhongyuan Wang and Zheng Liu}, year={2026}, eprint={2607.21461}, archivePrefix={arXiv}, primaryClass={cs.AI}, url={https://arxiv.org/abs/2607.21461}, } ```