Meta's AI Moderation Wrongly Deleted Business Accounts, NYT Finds

The pattern in the New York Times reporting by Stuart A. Thompson and Eli Tan is the part that should worry anyone whose business runs through a Meta account. Instagram and Facebook users say automated moderation wrongly deleted accounts they had spent years building, and when they tried to appeal, the appeal was often handled by another AI. Meta restored some of the accounts after journalists intervened, including one with nearly a million followers.

That loop is the shape of the problem more than any single ban. Automated enforcement at platform scale isn't new, but a system where the same class of AI both hands down the ban and adjudicates the appeal removes the last human failsafe. As the Times put it, users said the technology mistakenly deleted their accounts, and to resolve the issue, they still had to rely on AI. If you don't happen to know a reporter, the reporting suggests, you don't have a reliable route back.

Meta's counter is worth taking seriously and worth reading skeptically. The company told the Times that its newer AI moderation tools make 13 percent fewer mistakes and catch 10 percent more violations than humans, and it argued the accounts the paper examined were banned by older systems rather than the current models. Both things can be true at once and still leave the underlying complaint unaddressed, because from a small business's point of view, an older-generation false positive that costs them their audience is the same outcome as a newer one would be.

The honest caveat is that the reporting doesn't tell us how often accounts are wrongly killed in absolute terms, how the error rate breaks down across categories like fraud or spam or child-safety flags, or how many bans get reversed without a journalist making a phone call. Meta's 13 and 10 percent are the company's own numbers, and the accounts the Times examined are by construction the worst cases, not a representative sample.

The forward-looking piece is who this is a gift to. Anyone selling durable, owned-audience infrastructure such as email lists, SMS, and direct commerce gets a fresh talking point, and rival platforms that can credibly promise a human at the other end of an appeal have an opening with the creator and SMB market that Meta has spent a decade cultivating.