Join free with your email
Free. No spam, ever — we'll never share your email address and you can opt out at any time. Already a subscriber? Log in
Researcher with public evidence across AI research, Culture, work & education.
arxiv.org/abs/2605.26099 Language Models Need Sleep "attention mechanism scales poorly with context length. To handle this, we study a sleep-like consolidation mechanism in which a model periodically converts recent context into persistent fast weights before clearing its key-…
I wrote about AI in academia. "PhD-level thinking", LLM bias, grunt work, alignment, AGI, data center water use, AI politics -- something for everyone.
A collaborative math project, started by Terence Tao, showed that mathematics could be conducted experimentally, and worked on by large groups of mathematicians at once. In doing so, it turned up something genuinely new.
circa 2010 during my PhD in a comp neuro/machine learning institute, at a computer vision seminar I asked a naive question and speaker said, yeah there is a running joke in ML that what we really need is 'a big model that knows everything'. Cue a chuckle from the audience How blind we were
Center = Cian O'Donnell. Left = members they follow (green edges). Right = members who follow them (blue edges). Top = mutual follows (orange edges, slightly larger). Drag any node to reposition; click to open that profile.