AI slop buries real ML research on arXiv

ML researchers are losing the ability to track genuine progress in their own field. A post by a final-year undergrad on r/MachineLearning went viral this week, arguing that AI-generated filler research has so saturated arXiv and conference pipelines that real breakthroughs now disappear into noise before the community can evaluate them. The thread drew responses from researchers across career stages, with specific complaints about benchmark gaming passing peer review, hallucinated citations slipping through, and the sheer volume of low-signal submissions making it economically irrational to read new papers carefully. arXiv recently issued a one-year ban for hallucinated references, signaling that enforcement mechanisms are being tested but are not yet scaling. Essentially: (arXiv, major ML conferences) are the chokepoints where AI-generated slop is degrading the field's self-correction infrastructure. - arXiv flooding means even well-cited work can be seeded with fabricated references that reviewers miss under submission volume pressure. - Conference peer review quality is falling as the pool of competent reviewers cannot keep pace with submission growth driven partly by LLM-assisted paper mills. - Benchmark gaming compounds the problem: results that look impressive in aggregate resist falsification when reviewers lack time to audit methodology. The deeper issue is that academic AI research depends on trust in the literature as a shared record of what works, and that record is now actively contested.