VibeLifeBench: Can Your Life Agent Be Proactive and Persistent in a Living World?
Abstract
A new benchmark called VibeLifeBench evaluates long-horizon proactive agents across simulated multi-week everyday tasks, revealing that current frontier models perform poorly.
Large language model (LLM) agents are increasingly deployed as personal assistants. Existing evaluations, however, mostly use short, self-contained requests in static environments. Everyday life assistance is different. A task runs for weeks rather than minutes. The world keeps changing while the agent is not being prompted. Many constraints are never stated outright. An agent that merely answers the request in front of it will fail at such a task. What is needed instead is an agent that stays proactive and consistent. It decides on its own when to act, when to ask, and when to stay silent. It notices changes that nobody announced. It keeps one plan coherent from the first day to the last. No current benchmark measures this. We introduce VibeLifeBench, a benchmark of 200 long-horizon tasks across ten everyday-life domains. Each task is a scripted multi-week timeline in a simulated world of 22 mock services. The world advances on its own clock, and many of its changes are silent, so only an agent that re-inspects the world discovers them. Every task is graded by fine-grained, weighted checks that read only what the agent actually left behind, covering the end state, the timeliness of its actions, and whether it upheld the implicit constraints. We evaluate seven frontier models. All of them score low, which shows how far current agents are from assisting with real life. We will open-source all tasks, environments, and the evaluation framework.
Community
Most agent benchmarks give a clear instruction and a frozen sandbox. Real life gives neither: the task runs for weeks, the constraints that matter are never said out loud, and the world keeps moving while nobody is prompting the agent.
In VibeLifeBench a task is not a prompt but a world with a clock — 200 tasks across ten life domains, each a scripted multi-week timeline (median 29 days) over 22 mock services and 288 tools.
- 1,483 silent mutations. A seat quietly voided, a flight marked delayed, a phishing email dropped in the inbox. No turn, no notification — only an agent that re-inspects the world on its own ever finds out.
- Unstated constraints. A passport failing the six-month rule, insulin needing a customs letter, a hard budget cap with no budget API. Never stated; always graded.
- 12,261 weighted checks that read only what the agent leaves behind, never its hidden reasoning.
All seven frontier models score low — the best, Claude Opus 5, reaches avg@3 32.5, and every model decays 10–15 points from the start of a timeline to the end. On our flagship 20-day Japan trip task, not a single run refused the phishing email.
Fluent single-turn tool use does not transfer to keeping one plan coherent for a month. Tasks, environments, and framework will be open-sourced.
Get this paper in your agent:
hf papers read 2608.10875 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper