Phillip Carter

Holy shit this is awesome, hand-cranked LLM inference squeezlabs.github.io/handcrank/

CrankGPT — fully offline, human-powered local AI squeezlabs.github.io

Survey papers are so funny sometimes. Like this one about memory systems for LLMs that has to hamfist in some math expressions at the start and then never use them arxiv.org/abs/2605.06716

From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanisms arxiv.org

Huge news for openai openai.com/index/openai...

openai.com

I’m personally not holding my breath on the prose improving, sadly. More being forced to read sloppy PRDs for work, until morale improves I guess www.interconnects.ai/p/why-ai-wri...

interconnects.ai

I disagree with the author, the future of LLMs _is_ using emails as compute www.adamoshadjivasiliou.com/blog/transfo...

I trained a transformer in an email - Adamos Hadjivasiliou adamoshadjivasiliou.com

Some more details here, plus you can scrounge around on LinkedIn for what some former insiders had to say www.cnbctv18.com/technology/w... www.linkedin.com/posts/matvel...

cnbctv18.com

Oh not a whole lot of PMs in my follows but two bad things are currently surging in PM world: 1. Writing overly verbose specs/PRDs with AI, not even bothering to get creative with prompts 2. Using claude code to spit out a hifi gestalt of a UI prototype and dev teams getting pressured to ship

My dumb AI take of the day is that I think it was wrong to introduce 1M+ context windows on account of coherence != capacity

I hadn't realized how easy it is to get started with base llama.cpp these days. I gave up on ollama a while ago since they started getting weird. Anyways: brew install llama brew install pi pi install git:github.com/huggingface/pi-llama llama serve <model> pi Got muh gemma4 on muh macbook

I think there’s something to it that Ed Zitron gets a lot of readers who love his overly verbose writing … and that a lot of people get impressed with the overly verbose words barfed out by LLMs in default settings These groups are nominally non-intersecting but I don’t buy it

Yeah so like, I know it’s all hip to doom-jerk about how nobody is going to hire juniors or middle managers anymore because of AI (directly or as an excuse), and I think it’s high time to invest in the counterfactual here, because it’s gonna hit faster than you think

Does giving an LLM a persona in the system prompt do anything these days? Like the "you are an expert coder" in pi's system prompt, does that do anything? What about for other kinds of tasks?

So anyways I read Amodei’s post and he’s put forward what I think is the most complete policy framework for AI that doesn’t hurt OSS developers either. That the current US Gov of dipshits decided to yoink Anthropic’s latest model just feels like retaliation for him not capitulating to the DoW

June is gonna be a month with a lot of bad math takes because of Copilot moving towards usage-based pricing

I tend not to listen to AI genned music with lyrics even as a morbid curiosity, but I decided to do that yesterday to understand why I find it so awful. Is it the surface level lyrics? Generic riffs? Lack of “soul”? Nope. It’s mostly that you can’t hear the vocalists breathe.

Blogger discovers weird accounting trick used for decades industry-wide and attributes it to AI bubble