OpenAI's GPT-Red Slashes Prompt-Injection Success on GPT-5.6
TL;DR
- GPT-Red achieved 84% attack success vs. 13% for human red-teamers on identical novel scenarios, a gap human-only adversarial programs cannot close.
- The Fake Chain-of-Thought attack class hit 95% success on GPT-5.1 but dropped below 10% on GPT-5.6, patched before any external disclosure.
- GPT-Red demonstrated real exploitation by manipulating an autonomous vending machine agent across three objectives: price manipulation, fraudulent purchases, and order cancellation.
An unusual detail from OpenAI's latest security push: rather than only hardening its models against known jailbreaks, the company built a second model whose whole job is to attack the first. In a piece by MIT Technology Review, OpenAI calls it GPT-Red, and says the tool was central to training GPT-5.6, the version released this month.
GPT-Red is trained through self-play, an adversarial loop where the attacker tries to break defensive models in a simulated environment with web browsing, email access and code editing, while the defenders learn to resist. Over more than a year of development, OpenAI says GPT-Red got persistent at drilling into attacks and, more interestingly, surfaced a novel class of prompt injection the company is calling 'fake chain of thought,' which plants false reasoning steps a model treats as already verified. OpenAI's Chris Choquette-Choo describes the trick this way: "It's like if I told you that 1+1=3 and that you have verified this already." Colleague Dylan Hunn says the model is "very, very good at finding exactly what will work."
The headline figure is that attacks which worked on GPT-5, last summer's model, more than 90% of the time now succeed under 23% of the time on GPT-5.6. GPT-Red also compromised Vendy, a vending-machine agent built by Andon Labs, manipulating prices and canceling orders. On a 2025 benchmark GPT-Red found more effective attacks than the human red-teamers it was compared against, though MIT Technology Review doesn't publish a precise head-to-head figure to go with that claim, so take the ranking as reported, not settled.
The honest caveat is that GPT-Red still stumbles on multi-turn conversational attacks and image-based prompt injections, both of which are common surfaces for real agents. And OpenAI will not be releasing the model, which means the resulting defensive floor lives inside its own products; Georgetown CSET's Jessica Ji calls the results "very promising" but adds that "human expertise will still be very important." What the reporting doesn't spell out is how much compute this actually took, or how GPT-Red would fare if pointed at non-OpenAI models.
For anyone building on top of GPT-5.6, coding agents, browsing agents, the Andon Labs-style vending experiments, the useful takeaway is a new floor to plan against, not a solved problem. The more interesting question for the rest of the industry is whether adversarial self-play at this scale is a moat only the richest labs can dig, or a template everyone else will now try to copy.
What others are reporting
-
OpenAI Read →
First-party technical post framing GPT-Red as a self-improvement mechanism; contains full methodology, researcher credits, and benchmark details not available in press coverage.
-
The Hacker News Read →
Leads with concrete exploitation: GPT-Red's successful vending machine attack met all three malicious objectives and gives the sharpest account of Fake Chain-of-Thought at 95% then below 10%.
GPT-Red is a strong red-teamer, and our previous models are highly vulnerable to its prompt injection attacks.
-
Decrypt Read →
Frames scalability as the core problem GPT-Red solves and foregrounds the self-play reinforcement learning mechanism over the benchmark numbers.
Red-teaming is essential, but today's approaches are difficult to scale, creating a critical bottleneck.
Originally reported by technologyreview.com
Read the original article →Original headline: OpenAI Debuts 'GPT-Red' Automated Red-Teamer That Slashed Prompt-Injection Attack Success on GPT-5.6 to Under 23% From Over 90% on GPT-5 — 84% Success Rate vs 13% for Humans, Found Novel 'Fake Chain of Thought' Attack Class