AI in moderación de contenido: 27 real deployments

Deployed LLM-based detector that identifies signposting ads routing users to child sexual abuse material by analyzing ad destinations rather than ad creative

Reported: Took action on 33.2 million pieces of child-exploitation content in H1 2026; over 97% caught by automated systems before user reports

Joining Lantern cross-platform child-safety coalition to share signals of potentially violating user behavior across platforms

operates ChatGPT in production; internal safety team flagged user sessions about gun violence but leadership overruled recommendation to contact police

Reported: linked to Feb 10 Tumbler Ridge school shooting that killed eight; British Columbia filed suit on Sept 21; 37 existing claims filed against OpenAI

deploys automated AI classifier to flag EU ads as 'social issues, elections, or politics' content

Reported: Teatre Raval's ads for a Virginia Woolf staging were blocked for mentioning feminism, civil rights, and social reform; theatre called the auto-moderation an 'injustice'

Apple deployed on-device AI in iOS 27 to detect and blur gore and violent content inside live FaceTime calls and other apps, expanding Communication Safety beyond existing nudity detection

AI-based Intelligence and Investigations system that flagged a user account for gun violence activity and planning eight months before the Tumbler Ridge attack

Reported: OpenAI deactivated the flagged account; the shooter opened a second account that the company did not know about until after the attack

Rolling out AI-generated profile labels and reach throttling for AI persona accounts that fail to self-identify

Disrupted a Russian covert-influence cluster that used ChatGPT via VPNs to generate English-language social media posts and build a fake think tank called the International Burke Institute

Reported: disrupted Russian covert-influence cluster; operation rated Category Three on the Brookings Breakout Scale

Deployed AI content detection combined with user feedback to identify and reduce AI-generated content on the platform

Reported: cut views of content classified as AI slop by 40% in recent weeks; feedback button clicked more than 1 million times since July 30 launch

Operates AI-driven spam classifier in Gmail; modified policy to allow verified political candidates, parties and PACs to bypass the classifier provided their spam rate stays below 0.3%

Human reviewers monitoring ChatGPT conversations for threats of violence and reporting to law enforcement

Reported: Reviewers flagged conversations detailing plans for violence and alerted the FBI; analyst received eight years of probation

Introducing labels, throttles and bans on low-effort AI-generated content on the platform

Reddit uses an LLM-powered Rules Hub to judge whether posts and comments match the intent of each community's rules.

Reported: The tool was piloted with more than 700 subreddits and is now available to all new communities, with a full rollout planned later in 2026.

TikTok is shifting trust-and-safety work toward AI-driven moderation as part of a global operational restructuring.

Reported: TikTok is closing its Nashville office and cutting 250 employees, including much of its content-moderation team.

LinkedIn added a user-reporting control for suspected AI-generated posts and feeds those reports into its AI-detection classifiers.

Reported: A cited detection study estimated 41% of long-form and 30% of short-form LinkedIn posts were likely AI-generated.

Meta removed its AI-driven automated hate-speech content moderation on Facebook in January 2025, replacing it with a Community Notes model on the rationale that it had been 'over-enforcing'.

Reported: Abusive and racist posts targeting US legislators tripled within six months; violent threats quadrupled; threats against President Trump doubled from 800 to 1,900 posts.

Meta is using AI to analyze physical cues including height and bone structure across photos and videos on Facebook and Instagram to identify and deactivate accounts of users under 13, combined with text, bio, and behavioral signals.

Required by Alabama settlement to offer teens a non-personalized content feed, two-hour daily usage cap, midnight-to-6am ban, and tighter parental controls, modifying the algorithmic recommendation system targeted for its addictive properties

Reported: $100M settlement payment; up to $300M possible if certain conditions are met

Excluding fully AI-generated songs from official charts effective August 29, with authority to remove ineligible recordings, alter chart positions, and revoke awards; tracks using AI as a supporting tool that remain substantially human-made may still chart

Mandatory 'Made With AI' labeling on tracks, compositions, artwork, and music videos where generative AI played a material role

Deploying AI detection to identify and badge likely AI Persona artist accounts, excluding flagged content from personalized recommendation tools

deployed automated AI-generated content detector that applies top-down penalties to videos flagged as AI slop

Reported: wrongly flagged a human-made Kurzgesagt video, resulting in the channel's worst-performing upload since 2013 despite above-average CTR and watch time; platform overturn rate is roughly sub-1%

TIDAL deployed automatic detection and tagging of wholly AI-generated music, blocking such tracks from earning royalties, removing artist impersonations, and rolling out a listener-facing 'AI' badge.

Chancellor deployed AI to flag books and course materials touching on sexual orientation, gender identity and other topics for elimination from the curriculum

Wake County schools' revised AI policy bans AI detection programs, citing technical unreliability, inaccuracy and potential bias against specific student populations, replacing detector flags with teacher judgment and Honor Code acknowledgment of AI use.

Reported: A Green Hope High School student given a zero on a detector's flag appealed and had the grade changed to 100 when a second teacher found no AI use.

Conducted Qinglang campaign to remove AI-generated unlawful content and penalize platforms hosting it

Reported: 5.61M pieces of AI-generated or AI-related unlawful content removed, more than 49,000 accounts penalized, 2,400+ websites and apps acted against

Roblox deployed an AI-powered age-verification system and a real-time multimodal moderation stack that scans avatars, text, and 3D objects together across the platform.

Reported: Full-year 2026 bookings forecast cut by roughly $1B as the systems restricted communication and slowed new-user acquisition; Q1 DAUs rose 35% versus the 44% Wall Street expected