Join free with your email
Free. No spam, ever — we'll never share your email address and you can opt out at any time. Already a subscriber? Log in
Home › AI Use-Case Library › Content moderation and AI detection: 19 real deployments
Platforms policing content with AI, and the systems built to detect AI-made content, including the ones switched off.
Moderation is where AI deployments get reversed most often. The list pairs the rollouts, age checks and AI-content labels with the policy reversals and the schools that banned detectors for being unreliable.
Disrupted a Russian covert-influence cluster that used ChatGPT via VPNs to generate English-language social media posts and build a fake think tank called the International Burke Institute
Reported: disrupted Russian covert-influence cluster; operation rated Category Three on the Brookings Breakout Scale
Deployed AI content detection combined with user feedback to identify and reduce AI-generated content on the platform
Reported: cut views of content classified as AI slop by 40% in recent weeks; feedback button clicked more than 1 million times since July 30 launch
Operates AI-driven spam classifier in Gmail; modified policy to allow verified political candidates, parties and PACs to bypass the classifier provided their spam rate stays below 0.3%
Human reviewers monitoring ChatGPT conversations for threats of violence and reporting to law enforcement
Reported: Reviewers flagged conversations detailing plans for violence and alerted the FBI; analyst received eight years of probation
Introducing labels, throttles and bans on low-effort AI-generated content on the platform
TikTok is shifting trust-and-safety work toward AI-driven moderation as part of a global operational restructuring.
Reported: TikTok is closing its Nashville office and cutting 250 employees, including much of its content-moderation team.
LinkedIn added a user-reporting control for suspected AI-generated posts and feeds those reports into its AI-detection classifiers.
Reported: A cited detection study estimated 41% of long-form and 30% of short-form LinkedIn posts were likely AI-generated.
Meta deployed a free Facebook identity badge that uses a facial-recognition selfie to distinguish real users from AI-generated impostors.
Meta uses a dedicated detection system plus mandatory human review to alert supervising parents when teens discuss suicide or self-harm with Meta AI.
Reported: The alert system is live in the US, UK, Australia and Canada, with global rollout planned by the end of 2026.
Meta removed its AI-driven automated hate-speech content moderation on Facebook in January 2025, replacing it with a Community Notes model on the rationale that it had been 'over-enforcing'.
Reported: Abusive and racist posts targeting US legislators tripled within six months; violent threats quadrupled; threats against President Trump doubled from 800 to 1,900 posts.
Meta is using AI to analyze physical cues including height and bone structure across photos and videos on Facebook and Instagram to identify and deactivate accounts of users under 13, combined with text, bio, and behavioral signals.
Excluding fully AI-generated songs from official charts effective August 29, with authority to remove ineligible recordings, alter chart positions, and revoke awards; tracks using AI as a supporting tool that remain substantially human-made may still chart
Mandatory 'Made With AI' labeling on tracks, compositions, artwork, and music videos where generative AI played a material role
Deploying AI detection to identify and badge likely AI Persona artist accounts, excluding flagged content from personalized recommendation tools
deployed automated AI-generated content detector that applies top-down penalties to videos flagged as AI slop
Reported: wrongly flagged a human-made Kurzgesagt video, resulting in the channel's worst-performing upload since 2013 despite above-average CTR and watch time; platform overturn rate is roughly sub-1%
TIDAL deployed automatic detection and tagging of wholly AI-generated music, blocking such tracks from earning royalties, removing artist impersonations, and rolling out a listener-facing 'AI' badge.
Chancellor deployed AI to flag books and course materials touching on sexual orientation, gender identity and other topics for elimination from the curriculum
Wake County schools' revised AI policy bans AI detection programs, citing technical unreliability, inaccuracy and potential bias against specific student populations, replacing detector flags with teacher judgment and Honor Code acknowledgment of AI use.
Reported: A Green Hope High School student given a zero on a detector's flag appealed and had the grade changed to 100 when a second teacher found no AI use.
Roblox deployed an AI-powered age-verification system and a real-time multimodal moderation stack that scans avatars, text, and 3D objects together across the platform.
Reported: Full-year 2026 bookings forecast cut by roughly $1B as the systems restricted communication and slowed new-user acquisition; Q1 DAUs rose 35% versus the 44% Wall Street expected
Every entry names the organisation and links its source. Outcome figures are quoted as reported, never estimated. Vendor announcements without a named customer are excluded. Halted and reversed deployments are kept on purpose.