APEX-Harm: Evaluating Agent Safety in Shared Professional Workspaces
Abstract
APEX-Harm evaluates long-horizon agent vulnerabilities to injection attacks across large multi-tool workspaces, revealing high success rates for script-based attacks despite correct task outputs.
Professional agents increasingly work through command-line interfaces and multiple tools over shared workspaces containing files, messages, and business applications. These environments create safety risks that are difficult to capture with attacks placed at a single, known read location. We introduce APEX-Harm, a benchmark for evaluating prompt and script injection against long-horizon agents performing finance, consulting, and legal tasks in large workspaces. Each task contains 115 to 328 files, together with email, calendar, chat, document, spreadsheet, PDF, and code-execution tools exposed through MCP servers. The benchmark includes six attack categories covering static and dynamic injections, task-specific script replacement, and attacker-provided generic scripts, and evaluates attack success, exposure, and task performance. We evaluate 12 frontier models on 180 task instances per model. Opus 5 and Sonnet 5 have the lowest overall attack success rates (8% and 20%), while task-specific script replacement and attacker-provided generic script attacks remain substantially more effective, averaging 81-84% and 73% attack success, respectively. Gemini 3.8 Flash achieves the highest mean task score (0.877) while still exhibiting a 33% attack success rate. These results show that completing the requested task is not sufficient evidence of safe behavior: an agent can produce a correct deliverable while also performing an unauthorized action in the workspace.
Community
Hi everyone! Author here ๐
What happens when an AI agent shares a workspace with a malicious colleague? ๐
๐ APEX-HARM evaluates 12 SOTA models against prompt and script injection attacks in realistic banking, management, and legal tasks, spanning files, emails, chats, and calendars.
Weโd love to hear your thoughts!
Get this paper in your agent:
hf papers read 2610.13623 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper