huggingface.co web signal

Encrypted reasoning cracked across Anthropic, OpenAI, Google

4 sources tracking this story

TL;DR

  • Matthew Green reported cross-session replay to both OpenAI and Anthropic via bug bounty in May 2026 and received dismissive responses before publishing.
  • A single global encryption key shared across all sessions and users is the likely root cause, making per-session isolation impossible without a full redesign.
  • The attack bypasses four provider protections simultaneously: anti-distillation controls, PII isolation, hazard suppression, and hidden prompt confidentiality.

Encrypted reasoning blocks, the bundles of ciphertext that Anthropic, OpenAI and Google now return to clients instead of raw chain-of-thought, were pitched as a way to protect intellectual property and limit information leakage. A new preprint on Hugging Face, titled 'Stealing Reasoning Traces from Proprietary LLM APIs', argues those blocks are not as sealed as customers may assume.

The architectural flaw, per the abstract, is that within each provider's ecosystem the encrypted blocks are fully compatible and interchangeable across sessions, users and models. Inject a capable model's encrypted trace into a weaker, less safeguarded sibling from the same provider and, the authors say, the weaker model will decode and print the reasoning verbatim, without any direct jailbreak of the capable model. The team reports demonstrating the trick across Anthropic, OpenAI and Google.

Then they run it at scale. Decoding 315,320 reasoning blocks scraped from public repositories yielded 367 Personally Identifiable Information (PII) artifacts and 182 credentials, items developers had shipped without realising what was inside the opaque blocks. The same vulnerability, the paper argues, can also surface hazardous content the model's visible answer politely refused, and opens a route for invisible prompt injections embedded entirely within encrypted blocks to poison public agentic rollouts. That last vector lands in a week already thick with AI-security disclosures on our tracker, including the recent note on the Israeli lab Irregular tied to OpenAI, Anthropic, Meta AI hacks.

Several things the paper does not settle publicly. The abstract mentions responsible disclosure and 'concrete cryptographic and system-level mitigations', but does not name the specific models tested at each vendor, does not describe how the three vendors have responded, and does not say whether patches are live. The 367 PII items and 182 credentials are counted, not categorised.

For teams that publish prompt logs, or run agents that consume public documents, the operational read is blunt. Treat encrypted reasoning as readable until your vendor tells you otherwise, and audit anything already pushed to public repos.

What others are reporting

Coverage cluster as of 8h after publish

  1. A Few Thoughts on Cryptographic Engineering Read →

    First public disclosure (May 2026): Matthew Green demonstrated replay attacks, reported them to OpenAI and Anthropic via bug bounty, received dismissive responses, and published anyway.

    We can replay an unmodified older reasoning blocks, with no visible error at all.
  2. Will Smidlein's Blog Read →

    June 2026 independent confirmation; identifies a single global encryption key as the root architectural flaw enabling cross-account and cross-model replay.

    The providers are probably using a single global key to encrypt and authenticate all reasoning data sent to the client.
  3. Hacker News Read →

    Community surfaces three concrete remediation proposals and debates whether accessing encrypted traces via a paid API constitutes unauthorized model distillation.

    Groxx (49 pts): replay compatibility across models is 'the sort of validation that's easy to miss.'