AI bubble vs. FIFA world cup vs. Summer Heat wave
For your Embodied AI task you want a recurrent model with constant complexity per step, but you don't want to lose the power of transformers (which store the full obs history and attend to it)? Do not despair, we have your back. We distill transformers into recurrent transformers 1/8
My Dad made fun of me for my use of "please" when talking to Claude. His point: the AI does not care. My point: this is not about the AI but about me.
I declined ACing for ICLR 2027 (but will review!), I am not comfortable with the load of LLM generated text to deal with: over-length reviews, over-length rebuttals. Humans digest machine output, it does not make sense! 😬 ICLR should take a step back, use 1-page pdf rebuttals as CVPR always did.
Excellent Keynote by @akorba.bsky.social at Cap-Rfiap in Montpellier, France, on machine learning and distances between distributions.
Goodhart's law states that "When a measure becomes a target, it ceases to be a good measure". Conference peer-review is a measure, arguably now mostly implemented through LLMs, and will become a target. Ergo, future academic research will target what Claude finds interesting and acceptable.
It is 2030 and we ran out of English phrases which we can still use because of they are not frequently employed by LLMs.
ICRA panel on the impact of AI and the paper avalanche on robotics conferences and journals. The same problems arrise in ML and in CV of course.
In 2026 the accepted papers are the ones which were reviewed by the same LLM which the authors had used to check the paper before submission.
In the book "The Diamond Age" (1995) by Neal Stephenson, a working class child jumps social classes with the help of a unique interactive book, a personal trainer which answer all her questions and allows her to learn first. For centuries we waited for this. Anti-AI crowd: AI is anti teaching!! 😡
