"Like a cat leaving a dead bird at your doorstep, Anthropic catalogs the grim future that its products might produce, shrugs its shoulders and then returns to its furious efforts to make these warnings a reality." 😂 www.nytimes.com/2026/06/17/o...
Melanie Mitchell
Professor at the Santa Fe Institute, AI and cognitive science
Professor at the Santa Fe Institute, AI and cognitive science with public evidence across AI research.
- AI signals
- 4 past 30d
- Sources
- 3 distinct domains
- Discussions
- 4 past 30d
- Latest signal
- 9d ago
Articles & links
Worth revisiting this prescient paper from @mmitchell.bsky.social and others from @hf.co : arxiv.org/abs/2502.02649
- Four Hugging Face researchers argue in an arXiv paper that fully autonomous AI agents should not be developed.
- The paper proposes a five-level autonomy scale, from a Level 1 simple processor to a Level 5 agent that writes and executes its own code.
- Their central claim is that risks to people scale with how much control the user cedes to the agent.
I agree with this essay: open source, for general software and for AI, has been and will be a net win for society. Kudos to @natolambert.bsky.social for being such an eloquent advocate. www.interconnects.ai/p/banning-op...
Yet another way to jailbreak LLMs: When asking them for forbidden information, make them think the request is part of their chain-of-thought: arxiv.org/abs/2603.12277
- A new ICML 2026 paper argues prompt injection succeeds because LLMs judge the source of text by how it sounds, not by role tags.
- The authors' role probes show injected text lands in the same representational space as the trusted role it imitates, predicting attack success before generation.
- Their CoT Forgery attack hits around 60% success on frontier models, while a destyling defense reportedly drops success from 61% to roughly 10%.
It's always a treat to read Ted Chiang's thoughts on AI. www.theatlantic.com/philosophy/2...
I'm just now reading @randomwalker.bsky.social's writeup of his ICML keynote. It is very insightful. Everyone thinking about the future of work in the age of AI should read this. www.normaltech.ai/p/what-will-...
I wrote a piece for the Yale Review on AI and "jagged intelligence". (Note: headline was not written by me.) yalereview.org/article/mela...
- AI systems excel on some tasks while failing surprisingly on similar ones, a pattern Mitchell calls 'jagged intelligence.'
- Ilya Sutskever, OpenAI cofounder, is quoted saying LLMs 'generalize dramatically worse than people' in a way that is 'very fundamental.'
- Mitchell says AI researchers, herself included, are still struggling to design effective evaluation methods for LLMs' uneven capabilities.
Also, Shannon's original proposals for language modeling? And even earlier, Markov chains? In case it's helpful, I wrote a bit about the history here: oecs.mit.edu/pub/zp5n8ivs...
arxiv.org/pdf/2411.02478
I recommend this article about AI reasoning, where the author lets us in on his struggles w/ AI cognitive dissonance. Plus some priceless quotes from @rao2z.bsky.social. (My recommendation has *nothing* to do with the fact that I'm quoted in it too 😇) www.quantamagazine.org/is…
Another excellent post (from @sayash.bsky.social and @randomwalker.bsky.social) on questions to ask about announcements of AI capabilities. I highly recommend their newsletter! www.normaltech.ai/p/did-google...
Another excellent post (from @sayash.bsky.social and @randomwalker.bsky.social) on questions to ask about announcements of AI capabilities. I highly recommend their newsletter! www.normaltech.ai/p/did-google...
Recent commentary
The ultimate tldr on the OpenAI "rogue model" hacking incident 😅 (h/t @linege1 on X) But it would be useful to know the prompts OpenAI gave to the model....
Why is Google AI Overview still so incredibly bad??
In Melanie Mitchell's orbit
Center = Melanie Mitchell. Left = members they follow (green edges). Right = members who follow them (blue edges). Top = mutual follows (orange edges, slightly larger). Drag any node to reposition; click to open that profile.