Schneier and Penney: AI will supercharge surveillance chill
TL;DR
- Schneier and Penney argue AI lets governments and companies ask models to draw conclusions from data they already hold, scaling inquiry beyond human limits.
- Penney's empirical research finds personalized legal threats or commands from authority figures produce powerful chilling effects on speech and behavior.
- The authors argue awareness of constant surveillance leads people to conform and self-censor, and AI will amplify that effect.
The shift Bruce Schneier and Jon Penney describe in The Guardian is not that governments and companies collect more data. That story is old. What is new, in their telling, is that the parties sitting on those piles of data can now hand them to models and ask for conclusions, which the authors describe as "supercharging the human work of inquiry with the limitless scale of AI."
The argument leans on Penney's own research area. His empirical work has found that "personalized legal threats or commands that originate from sources of authority can have powerful chilling effects on people's willingness to speak or act freely," a thesis he develops in his book Chilling Effects. Schneier and Penney's extension of that thesis is that AI collapses the cost of applying that kind of personalized pressure. What used to require an investigator's attention now scales, and the awareness of being reachable at scale is, they argue, enough to push people toward conformity and self-censorship before any specific consequence lands.
Why this matters if you are not thinking about civil liberties for a living: the same inference layer that would let a state cross-reference protest attendance with financial records is the layer companies are already buying to do "insight" on customers, employees, and users. The chilling-effect argument does not care whether the eye is state or corporate. If people believe their words feed a model that draws conclusions, the reporting suggests they will act as if they are being read, and the range of things they are willing to try shrinks.
The honest caveat is that this is an opinion essay, not new empirical work. Schneier and Penney do not put a number on how much larger the chill grows once AI enters the picture, they do not name which sectors will show measurable self-censorship first, and they do not spell out which technical guardrails would actually blunt the conclusion-drawing step they flag. Treat the direction as the argument, not the magnitude.
The forward-looking point is the useful one for anyone building or buying. The differentiating pitch for AI products increasingly cuts the other way, toward promises that inputs cannot be pooled, that inference stays local, that logs decay. If the authors are right about the chill, the vendors and jurisdictions that can credibly promise less will start to look more valuable, not less.
Shared on Bluesky by 2 AI experts
-
I have a new Op-Ed in @theguardian.com (with Bruce Schneier) on the social chill of AI surveillance. If widely deployed, it will be corrosive to democracy & social progress. We cite my new book #ChillingEffects on how su…
View on Bluesky → -
"We need not sit idly. Now that we recognize the danger of AI-enhanced mass #surveillance, we can make the policy choices not to implement it ... The chill of AI-powered mass surveillance will suffocate the very foundati…
View on Bluesky →
Originally reported by theguardian.com
Read the original article →Original headline: AI surveillance is being supercharged – and it will chill social progress | Bruce Schneier and Jon Penney