Papers
arxiv:2611.02017

Switch-SWE: Do Coding Agents Hold Focus When Switching Between Unfinished Tasks?

Published on Nov 1
ยท Submitted by
Qianli Ma
on Nov 4
Authors:
,
,
,
,
,
,
,
,

Abstract

A benchmark for resuming interrupted software tasks reveals performance drops from interleaved work, and a context-management module improves recovery.

Software development sessions often involve several unfinished tasks rather than one issue carried through to completion. As coding agents take on repository-level development, they need to recover an earlier task's requirements and partial progress after intervening work. Existing repository-level benchmarks typically score one issue-to-patch episode and do not directly measure whether an agent can resume a task after advancing other unfinished work in the same repository. We introduce \ourmethod, a benchmark for focus-task resumption in sessions that interleave unfinished tasks drawn from the same source repository, with a persistent checkout for each task. Each focus task is evaluated in matched uninterrupted and switched sessions with identical focus requirements and executable verifiers. The switched session interleaves ordered stages from other unfinished tasks in the same repository, while only the final focus patch is scored. \ourmethod~contains 200 focus tasks from 19 Python repositories, reconstructed from issue, pull-request, and review histories and rendered as 400 matched session specifications. Across 7 coding agents, interleaved unfinished work produces an average focus-task resolution gap of 11.5 percentage points, ranging from 6.0 to 15.0 percentage points. Trajectory analysis identifies cross-task requirement confusion and loss of task state as recurrent resumption behaviors. We introduce a plug-in context-management module that selects task-relevant history and maintains concise task-state summaries. On OpenCode, the module improves focus-task completion under same-repository task switching by 5.5 to 15.5 percentage points across the evaluated models. Code is available at github.com/Miraclecsc/Switch-SWE.

Community

Paper author Paper submitter

Switch-SWE is a repository-level benchmark for evaluating whether coding agents can resume a focus task after working on other unfinished tasks in the same repository. Each task is evaluated in matched uninterrupted and switched sessions, requiring agents to recover task-specific requirements and partial progress while avoiding cross-task confusion.

The benchmark provides 200 focus tasks from 19 Python repositories, 400 matched session specifications, and executable verifiers. Across seven coding agents, task switching reduces focus-task resolution by 11.5 percentage points on average. A plug-in context-management module that selects relevant history and maintains task-state summaries improves completion by 5.5โ€“15.5 percentage points on OpenCode.

๐ŸŒ Paper: https://arxiv.org/abs/2611.02017
๐Ÿ”ฅ Project Page: https://mqleet.github.io/Switch-Swe/
๐Ÿ•น๏ธ Code: https://github.com/Miraclecsc/Switch-SWE

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2611.02017
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2611.02017 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2611.02017 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2611.02017 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.