Home / AI Research / PIPETTE: Prompt Injection Purple-Teaming for Robust LLM Agents
PIAI Research
PIPETTE: Prompt Injection Purple-Teaming for Robust LLM Agents
· Lipeng He, Yihan Wang, Jiawen Zhang, N. Asokan
Large language model (LLM) agents routinely interact with untrusted external data, exposing them to indirect prompt injection (IPI) attacks that hijack agents into executing attacker-chosen tasks. To uncover these vulnerabilities at scale, automated red-teaming methods often leverage reinforcement learning (RL) to generate attacks that achieve high attack success rates (ASR). Model developers use the attacks discovered during internal red-teaming to harden agents through adversarial training before deployment, a collaborative offensive-defensive process known in cybersecurity as purple-teaming. However, we show that achieving high ASR during red-teaming does not guarantee robustness gains…
Upvotes8
Comments3
Published17 Nov 2026