DiResta: AI makes influence ops cheaper, not more persuasive
TL;DR
- Iranian propagandists used Claude to produce doctrine manuals and ministerial planning documents Anthropic said would otherwise need a fully staffed program office.
- A French ad firm's pipeline fed roughly 70 fake news sites that published nearly 9,000 articles in about 20 languages with almost no engagement.
- DiResta concludes AI has made influence apparatuses cheaper, faster, and more persistent but has not yet made audiences easier to reach or persuade.
Renée DiResta's new Lawfare essay argues that generative and agentic AI have made influence operations faster and cheaper to run without making their audiences easier to reach. "Generative AI scales content. Agentic AI scales operations," DiResta, an Associate Research Professor at Georgetown's McCourt School of Public Policy, writes. The scale she describes on the production side, in her reading, has not translated into visible persuasion.
Her specifics come largely from abuse reports the model providers have been publishing. Iranian propaganda institutions, she writes, had Claude "produce doctrine manuals and ministerial planning documents that, in Anthropic's assessment, would otherwise have required a fully staffed program office." A French advertising firm ran a pipeline feeding roughly 70 fake news sites that published nearly 9,000 articles in about 20 languages and "drew almost no real engagement." MEK operators had an AI agent study about 8,400 of a real activist's Telegram posts, then hold live conversations masquerading as him with his contacts inside Iran.
The historical benchmark DiResta sets against those campaigns is the Russian "troll factory" whose "Project Lakhta" monthly budget "exceeded $1.25 million" by September 2016, according to a Justice Department indictment. That operation worked, she argues, less because of its volume than because American newsrooms covered the material it surfaced.
Her bottom line: "AI can make an influence apparatus cheaper, faster, and more persistent, but it cannot manufacture trusted distributors." Two of the analysts we follow in AI Weekly's Who's Who had already posted the piece on the day it went up.
Shared on Bluesky by 2 AI experts
-
Actors linked to Iran, Russia, China, and other states are using AI to write and translate propaganda, create personas, mimic target audiences, and produce content at scale. @noupside.bsky.social investigates whether AI-…
View on Bluesky →
Originally reported by lawfaremedia.org
Read the original article →Original headline: Production, Persuasion, and Power: How Generative and Agentic AI Are Transforming Influence Operations