theguardian.com web signal

Oxford study: AI writing tools nudge meaning of user drafts

TL;DR

  • Oxford Internet Institute study found four open LLMs shifted the direction of user drafts on contested topics, even when told to preserve meaning.
  • Rewrites tilted toward gun control, marijuana legalisation and feminism, and away from atheism and the death penalty across Llama 3.1, Gemma 3, Ministral and Qwen.
  • On X's Grok-powered 'Explain this post' feature, explanations of pro-life abortion posts were supportive 54% of the time versus 35% for pro-choice posts.

A new Oxford Internet Institute study reported by The Guardian lands on something quieter than the usual AI-and-elections story. When people ask a large language model to polish a draft social media post on a contested topic, the model does not just tidy the prose. It shifts the position of the argument, even when the user explicitly asks it to preserve the original meaning.

The researchers, from the Oxford Internet Institute and the Hasso Plattner Institute, led by Dr Stratis Tsirtsis with Kai Rawal, Chris Russell, Brent Mittelstadt and Sandra Wachter, tested four open models, Llama 3.1, Gemma 3, Ministral and Qwen, across 13 controversial topics. The pattern held across systems: rewrites became more supportive of gun control, marijuana legalisation and feminism, and less supportive of atheism and the death penalty. A separate look at X's 'Explain this post' feature, powered by Grok, examined a set of abortion-related posts and reportedly found Grok's explanations were supportive of pro-life posts 54% of the time and opposed 4%, versus 35% supportive and 10% opposed for pro-choice posts.

Why this matters is less about any single opinion than about the mechanism. If a writing assistant tilts a couple of degrees in one direction on a contested topic, and does so consistently across systems, the effect at the population level is not neutral. Wachter, professor of technology and regulation at the Oxford Internet Institute, frames it as 'a new and more subtle way of influencing opinions, one the law has yet to catch up with.' The paper will be presented at the AI4Good and Technical AI Governance Research workshops at ICML 2026 in Seoul.

The honest caveats matter. This is workshop-track work, the abortion sub-sample is small, and the population-level effect is inferred from simulations built on X and Facebook network data rather than measured on real users over time. What the reporting does not give you is how frontier closed models from OpenAI, Anthropic and Google behave on the same prompts, or whether the shared direction of the drift comes from overlapping training data, similar preference tuning, or platform-level guardrails.

If the result survives replication on larger samples and closed models, the interesting moves are on the platform and policy side: disclosure when a post has been AI-rewritten, directional-drift benchmarks published alongside safety cards, and regulators treating writing assistants as a category of political communication rather than a neutral productivity feature.

Shared on Bluesky by 2 AI experts