nature.com web signal

DeepMind's SynthID-Text watermark ran live across Gemini

TL;DR

  • Google DeepMind deployed SynthID-Text inside Gemini and Gemini Advanced, the first production text watermark of its kind at scale.
  • Across nearly 20 million Gemini responses, watermarked and non-watermarked outputs showed no significant difference in user thumbs-up or thumbs-down rates.
  • The scheme weakens against paraphrasing, translation, and heavy edits, and only works for text from providers who adopt the same watermark.

Google DeepMind published something in Nature that most watermarking papers do not have: a live production result. In "Scalable watermarking for identifying large language model outputs", Sumanth Dathathri and colleagues at Google DeepMind describe SynthID-Text, a scheme that biases token sampling inside an LLM through a mechanism they call Tournament Sampling, so that later, given the text and a secret key, a detector can tell the output came from that model.

The interesting bit is the deployment. The team says the system has been running inside Gemini and Gemini Advanced, which they describe as the first deployment of a generative text watermark at scale, serving millions of users. To check whether watermarking degraded what users see, they compared feedback across nearly 20 million Gemini responses and reported no significant difference in thumbs-up and thumbs-down rates between watermarked and non-watermarked outputs. A side-by-side human evaluation on Gemma echoed that, with no significant difference in rater preference across the quality aspects scored.

DeepMind also open-sourced the implementation, which means outside labs can study, break, and iterate on the same mechanism rather than guess what Google is doing behind the API. That matters for a field where most claims about watermark robustness have come from single teams testing their own systems in controlled conditions.

The paper is candid about what a scheme like this cannot do. The signal weakens when text is paraphrased by another model, translated, or heavily edited, and it degrades on outputs that are very short or highly factual. The authors flag stealing, spoofing and scrubbing attacks as real threats, and detection only works for services that adopt the same scheme, so nothing here helps identify text from a model whose provider has not opted in. The Gemini evaluation reports user-satisfaction parity, not that watermarked outputs are indistinguishable for every downstream analysis.

The forward-looking read is about the shape of the AI-provenance debate. Regulators pressing platforms to label AI-generated content have been told for a while that it is not really feasible at scale for text; a running deployment across a mainstream chatbot changes the terms of that conversation, at least among cooperating providers. Whether other labs adopt SynthID-Text, converge on something interoperable, or hold back becomes the next question.