simons.berkeley.edu web signal

Are Transformers necessary? A data-centric view on generalization

By Alexis Dufresne Published September 30, 2026 at 21:12 UTC

Summary

Are Transformers necessary? A data-centric view on generalization

Shared on Bluesky by 1 AI expert

Ben Recht @beenwrekt.bsky.social: Check out this talk by Ludwig Schmidt from a few years ago. The transformer is important not because of some magical geometry fact, but beca… →

Originally reported by simons.berkeley.edu

Read the original article →

Original headline: Are Transformers necessary? A data-centric view on generalization