No spam, ever. We'll never share your email address and you can opt out at any time. Already a subscriber? Log in
Pretraining + fine-tuning powers modern ML, but we lack a theoretical understanding of how pretraining actually shapes downstream learning. In our new @icmlconf.bsky.social paper, we address this gap! 📅 July 9th, Poster #4502 Session 8! 🧵 arxiv.org/pdf/2602.20062
Is Muon as good as they say? We looked beyond training speed and found a hidden cost: Muon loses the simplicity bias of older optimizers like gradient descent — and this matters for generalization. Led by Sara Dragutinović and advised by Rajesh Ranganath arxiv.org/abs/2603.00742
Center = Andrew Saxe. Left = members they follow (green edges). Right = members who follow them (blue edges). Top = mutual follows (orange edges, slightly larger). Drag any node to reposition; click to open that profile.