---
title: AutoPI: a prompt-injection red teamer that measures how many different ways an agent breaks, not just how often, found working injections in all six technique classes against Qwen3.6-35B | ctxsec
url: https://ctxsec.com/items/arxiv-autopi-taxonomy-guided-adaptive-prompt-injection-red-teaming-coverage-not-just-success-rate-agentdojo-ipi-arena
description: "The authors argue attack success rate hides gaps: a red teamer can score high by reusing a few techniques, leaving the rest untested and missing from the attacks used to harden models. AutoPI walks a taxonomy of prompt-injection techniques (PIAtlas), writes an injection for every sub-technique and reworks failures using an LLM judge's feedback; it is black-box and needs no training. On AgentDojo it found a successful injection against Qwen3.6-35B in all six taxonomy classes and more than 90% of techniques. Against Claude Haiku 5.5, the most robust target tested, it got 20-50% higher success and 25-400% higher class-level coverage than recent adaptive red teamers. Code and generated attacks are released."
status: "research (arXiv preprint 2611.24313, Nov 18, 2026; not peer reviewed)"
published: 2026-11-18
---

> The authors argue attack success rate hides gaps: a red teamer can score high by reusing a few techniques, leaving the rest untested and missing from the attacks used to harden models. AutoPI walks a taxonomy of prompt-injection techniques (PIAtlas), writes an injection for every sub-technique and reworks failures using an LLM judge's feedback; it is black-box and needs no training. On AgentDojo it found a successful injection against Qwen3.6-35B in all six taxonomy classes and more than 90% of techniques. Against Claude Haiku 5.5, the most robust target tested, it got 20-50% higher success and 25-400% higher class-level coverage than recent adaptive red teamers. Code and generated attacks are released.

[← Context & Harness Attacks](/context) · [markdown](/items/arxiv-autopi-taxonomy-guided-adaptive-prompt-injection-red-teaming-coverage-not-just-success-rate-agentdojo-ipi-arena.md)

research (arXiv preprint 2611.24313, Nov 18, 2026; not peer reviewed)

2026-11-18 · published here

2026-11-21 11:44 AM ET

### AutoPI: a prompt-injection red teamer that measures how many different ways an agent breaks, not just how often, found working injections in all six technique classes against Qwen3.6-35B

- **For agent builders:** report technique coverage alongside success rate when you test injection defenses, and include attacks generated against your own tools, not just a fixed benchmark set.

Sources: [arXiv 2611.24313: AutoPI: Taxonomy-Guided Adaptive Red Teaming for Prompt Injection in LLM Agents (Damianakis, Psounis; Nov 18, 2026)](https://arxiv.org/abs/2611.24313)
