Papers
arxiv:2610.37161

WorkFactory: Turning Professional Intents into Executable Work for Scalable Agent Training

Published on Oct 27
· Submitted by
CHEN TINGYANG
on Oct 30
Authors:
,
,
,
,
,
,
,
,
,
,

Abstract

WorkFactory builds coherent professional tasks via information planning and repair, yielding WorkPilot models that improve expert-level agent performance across benchmarks.

Scaling supervised training for working agents requires diverse professional tasks that yield reliable expert demonstrations. However, missing or inconsistent task information can obstruct teacher execution and weaken the resulting supervision. We propose WorkFactory, a scalable framework for constructing coherent and executable professional tasks. Starting from professional intents, information-level planning builds an information support graph to guide task instantiation, explicitly representing the dependencies and locations of information required for the intended outputs. Probe executions then identify support failures and guide repairs while preserving the intended work. We construct 112,686 tasks spanning 612 occupations and use the collected teacher trajectories to fine-tune Qwen models at 4B, 27B, and 35B-A3B scales, yielding the WorkPilot family. All three models improve over their respective base models across four professional-work benchmarks, with WorkPilot-35B-A3B improving from 879 to 1565 Elo on GDPval-AA v2.1. Scaling analyses reveal model-dependent diminishing returns, with execution length first increasing and then decreasing. Controlled component analyses show that planning and repair reduce probe-diagnosed task environment defects and improve downstream performance. The data and models are available at https://github.com/IQuestLab/WorkFactory.

Community

Excited to share WorkFactory, a scalable framework for synthesizing coherent and executable professional tasks to train Working Agents!

WorkFactory combines professional intent synthesis, information support graphs, and execution-guided repair to construct high-quality tasks that enable reliable expert demonstrations.

We build 112,686 tasks spanning 612 occupations and train the WorkPilot model family at 4B, 27B, and 35B-A3B scales. All three models achieve consistent improvements across four professional-work benchmarks, with WorkPilot-35B-A3B improving from 879 to 1565 Elo on GDPval-AA v2.1.

We hope this work contributes to scaling general-purpose agents for real-world professional tasks!

Nice to see the probe-then-repair loop made explicit: letting an isolated probe attempt each task from solver-visible inputs only, and repairing just the blocking gaps before the GLM-5.3 teacher runs, feels like exactly the right place to spend compute in trajectory distillation. The scaling curve is interesting too: for Qwen3.6-35B-A3B the first 5K tasks add 447 Elo while going from 75K to 110K adds only 13, yet mean execution length keeps dropping from 162.88 turns at 2K to 85.90 at 110K. Do the later tasks mostly teach the student to finish more efficiently and fail fewer tool calls, rather than to produce better deliverables? I also noticed web-fetch failures stay around 40-48% across all checkpoints; is that a sandbox limitation, or something the teacher trajectories rarely demonstrate well?

·

Thanks for your interest and great questions!

For scaling, we think the student needs a certain amount of data to effectively learn the teacher's capabilities and shift toward its behavior distribution. As the dataset grows, the student gradually approaches the teacher's capability ceiling, so the gains naturally become smaller. Meanwhile, more data helps the student learn better planning and execution strategies, reducing unnecessary steps and tool calls. To push the ceiling further, we're looking into rejection sampling, harder tasks, and RL scaling.

As for web-fetch failures, they're mostly because some websites are inaccessible. Web-search has a much lower failure rate.

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2610.37161
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2610.37161 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2610.37161 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2610.37161 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.