OfficeTown: Generative Organizations for Evolving Agent Intelligence
Abstract
OfficeTown is a generative simulation framework that creates persistent professional organizations to generate work-grounded training data and evaluation benchmarks for AI agents.
AI agents increasingly use files and software tools to produce professional deliverables. Such work draws on materials, decisions, and feedback accumulated across assignments. We introduce OfficeTown, a generative simulation framework for professional organizations in which tasks and their context arise from continuing organizational work. From a natural-language description of an organization's purpose and activities, OfficeTown initializes an organization whose members coordinate work, delegate bounded assignments to assistant agents, and review their deliverables. Artifacts, decisions, and unresolved matters persist and shape subsequent work, while responsibilities and permissions determine what each member can see and do. We curate work requests, their context, and review feedback into executable resources for evaluation and learning. We construct OfficeTown Bench with 406 tasks and 4,836 evaluation criteria from 23 simulated organizations across eight professional domains, incorporating domain-expert feedback. Frontier-model evaluations reveal substantial remaining headroom. Supervised fine-tuning and on-policy distillation on OfficeTown data substantially improve Qwen3.5-9B on external professional-work benchmarks, including GDPval. Supplementary evaluations show that the principal--assistant harness achieves higher scores than the single- and multi-agent baselines tested. These results highlight the value of organizational simulation in generating work-grounded data and environments for the continued development of generalist agents.
Community
OfficeTown is a generative organizational simulation framework that creates thousands of persistent, tool-enabled professional work environments across diverse domains, generating realistic long-horizon tasks, contextual materials, agent trajectories, and feedback for benchmarking, supervised fine-tuning, and reinforcement learning of generalist AI agents.
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- Cowork-Gym: Synthesizing Interactive Work Environments at Scale (2026)
- EvoCowork: A Benchmark for Real-World Office Tasks (2026)
- Interlock: From Local Correctness to Task Completion in Long-Horizon Agents (2026)
- SkillHorizon: Constructing Long-Horizon Agent Tasks through Skill Composition (2026)
- WorkGenesis: Building the Worlds That Teach Agents to Work (2026)
- Scaling Verifiable Environments for Long-horizon Work Agents (2026)
- SkillGym: Internalizing Human Skills into LLMs for Real-World Problem Solving (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Get this paper in your agent:
hf papers read 2610.23194 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 1
Collections including this paper 0
No Collection including this paper