AI in moderación de contenido: 18 real deployments

Disrupted a Russian covert-influence cluster that used ChatGPT via VPNs to generate English-language social media posts and build a fake think tank called the International Burke Institute

Reported: disrupted Russian covert-influence cluster; operation rated Category Three on the Brookings Breakout Scale

Deployed AI content detection combined with user feedback to identify and reduce AI-generated content on the platform

Reported: cut views of content classified as AI slop by 40% in recent weeks; feedback button clicked more than 1 million times since July 30 launch

Operates AI-driven spam classifier in Gmail; modified policy to allow verified political candidates, parties and PACs to bypass the classifier provided their spam rate stays below 0.3%

Human reviewers monitoring ChatGPT conversations for threats of violence and reporting to law enforcement

Reported: Reviewers flagged conversations detailing plans for violence and alerted the FBI; analyst received eight years of probation

Introducing labels, throttles and bans on low-effort AI-generated content on the platform

Reddit uses an LLM-powered Rules Hub to judge whether posts and comments match the intent of each community's rules.

Reported: The tool was piloted with more than 700 subreddits and is now available to all new communities, with a full rollout planned later in 2026.

TikTok is shifting trust-and-safety work toward AI-driven moderation as part of a global operational restructuring.

Reported: TikTok is closing its Nashville office and cutting 250 employees, including much of its content-moderation team.

LinkedIn added a user-reporting control for suspected AI-generated posts and feeds those reports into its AI-detection classifiers.

Reported: A cited detection study estimated 41% of long-form and 30% of short-form LinkedIn posts were likely AI-generated.

Meta removed its AI-driven automated hate-speech content moderation on Facebook in January 2025, replacing it with a Community Notes model on the rationale that it had been 'over-enforcing'.

Reported: Abusive and racist posts targeting US legislators tripled within six months; violent threats quadrupled; threats against President Trump doubled from 800 to 1,900 posts.

Meta is using AI to analyze physical cues including height and bone structure across photos and videos on Facebook and Instagram to identify and deactivate accounts of users under 13, combined with text, bio, and behavioral signals.

Excluding fully AI-generated songs from official charts effective August 29, with authority to remove ineligible recordings, alter chart positions, and revoke awards; tracks using AI as a supporting tool that remain substantially human-made may still chart

Mandatory 'Made With AI' labeling on tracks, compositions, artwork, and music videos where generative AI played a material role

Deploying AI detection to identify and badge likely AI Persona artist accounts, excluding flagged content from personalized recommendation tools

deployed automated AI-generated content detector that applies top-down penalties to videos flagged as AI slop

Reported: wrongly flagged a human-made Kurzgesagt video, resulting in the channel's worst-performing upload since 2013 despite above-average CTR and watch time; platform overturn rate is roughly sub-1%

TIDAL deployed automatic detection and tagging of wholly AI-generated music, blocking such tracks from earning royalties, removing artist impersonations, and rolling out a listener-facing 'AI' badge.

Chancellor deployed AI to flag books and course materials touching on sexual orientation, gender identity and other topics for elimination from the curriculum

Wake County schools' revised AI policy bans AI detection programs, citing technical unreliability, inaccuracy and potential bias against specific student populations, replacing detector flags with teacher judgment and Honor Code acknowledgment of AI use.

Reported: A Green Hope High School student given a zero on a detector's flag appealed and had the grade changed to 100 when a second teacher found no AI use.

Roblox deployed an AI-powered age-verification system and a real-time multimodal moderation stack that scans avatars, text, and 3D objects together across the platform.

Reported: Full-year 2026 bookings forecast cut by roughly $1B as the systems restricted communication and slowed new-user acquisition; Q1 DAUs rose 35% versus the 44% Wall Street expected