Self-Improvements in Modern Agentic Systems: A Survey
Abstract
Self-improving autonomous agents are moving from research prototypes to deployed systems. The primary goal is controllable evolution, or adaptation, from experience with minimal or even no human input. This survey frames modern self-improving agents as adaptive systems that convert experience into accumulated capability gains. We offer a system-level framework that represents a modern agent as a configuration coupling a foundation model with an operational scaffold of prompts, memory, tools, and control logic. Within this framework, self-improvement is formalized as a self-induced update operator that obtains and commits updates to model parameters or scaffold components. We organize prior work by update target and by the signals that drive change, then review applications and discuss evaluation, before closing with open problems and future directions. For convenience, we track technical updates on https://github.com/selfimproving-agent/awesome-Self-Improving-Agents.
Community
We present a unified framework for self-improving agents, defining an agent as a foundation model plus scaffolding and organizing existing methods by what is improved: the foundation model or the scaffolding, including prompts, memory, tools, and control logic.
The survey connects early research on self-reference, meta-learning, and Gödel Machines with modern foundation-model-based agents. It also reviews representative applications, evaluation protocols, benchmarks, limitations, and open challenges.
We maintain a continuously updated project page and paper collection, and welcome feedback and missing references from the community.
Get this paper in your agent:
hf papers read 2607.13104 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper