What would you count as intelligent? Most recently, it reasoned for 250 pages and proved an important open math result, and found thousands of critical security vulnerabilities in important software. Surely that's at least intelligence within those domains? www.anthropic.com/r…
Ryan Moulton
Articles & links
This paper addresses the claim in the ML sense, that interpolation in high dimensions is more or less vacuous, but the sense people mean for LLMs is different, and I'm not sure whether we are using the right words. arxiv.org/abs/2110.09485
I know this in part comes from being self satisfied with my own writing and I might otherwise feel differently, but using AI to write feels like using AI to speak in person to your friends and family. open.substack.com/pub/samkriss...
I wrote this a few years ago, but I think it holds up, and might bridge the gap a bit. I think what LLMs are doing is intermediate between reasoning and retrieval, but the amount of reasoning has gone up as they've improved. moultano.wordpress.com/2023/06/28/t...
Recent commentary
I should have an LLM teach me electronics.