Very excited to have this out -- @kennypeng.bsky.social 's brainchild in thinking about the implications of sparse representations. He's on the job market, and watch out for some exciting tools we're releasing soon! arxiv.org/abs/2610.05794
A Testable Theory of Atomic Features arxiv.org
AI Weekly's analysis
→
- The paper's 'recovery principle' predicts sparse autoencoders of increasing size recover an increasing prefix of the most prevalent atoms in the training data.
- Three predictions were tested on SAEs ranging in size from 512 to 131,072, trained on two large embedding models.
- The authors argue the results contradict conventional wisdom that SAE features are unstable and 'split' as size increases.
Read full analysis →
View on Bluesky ·
♥ 11
↻ 1
↩ 0
·
2 from the directory shared this ·
16d ago
↻
Nikhil Garg reposted
↻
Nikhil Garg reposted
↻
Nikhil Garg reposted
Finally, we show that test time adaptation methods can mitigate some of these issues, though I'm still quite bearish on the long-term sustainability of these approaches arxiv.org/abs/2606.25152 Will appear in Neurips 2026!
Hitting a Moving Target: Test-Time Adaptation for AI Text Detection under Continual Distribution Shift arxiv.org
AI Weekly's analysis
→
Read full analysis →
↻
Nikhil Garg reposted
@harold.bsky.social
an agent system and a single 404 error got me in trouble with OpenAI and Cornell campus security. how did this happen? introducing: "agent meltdowns" (1/11) arxiv.org/abs/2605.19149
Agent Meltdowns: The Road to Hell Is Paved with Helpful Agents arxiv.org
View on Bluesky →
Paper here: arxiv.org/pdf/2107.07083. Old-ish paper, but newly accepted to Operations Research! With Wes Gurnee, David Shmoys, and David Rothschild.
arxiv.org
↻
Nikhil Garg reposted
Martin Saveski
@msaveski.bsky.social
Looking forward to giving a tutorial on 𝗦𝗼𝗰𝗶𝗮𝗹 𝗠𝗲𝗱𝗶𝗮 𝗙𝗲𝗲𝗱 𝗥𝗮𝗻𝗸𝗶𝗻𝗴 𝗔𝗹𝗴𝗼𝗿𝗶𝘁𝗵𝗺𝘀 with @tiziano.bsky.social at @ic2s2.bsky.social! 🕜 𝗧𝗶𝗺𝗲: Tuesday, 1-4 pm 📍 𝗟𝗼𝗰𝗮𝘁𝗶𝗼𝗻: Mansfield (210). 🌐 𝗪𝗲𝗯𝘀𝗶𝘁𝗲: social-media-ais.github.io/ic2s2-26-tut...
Social Media Feed Ranking Algorithms: Guide to Field Experiments social-media-ais.github.io
View on Bluesky →