Andrea Lathrop

Cognitive Science... tech stuff... dev psych... AI... former Aslin Lab (Master's) and Eppler Lab (with Jackie Gibson emeritus) so I'm a weird mix of Gibsonian affordances, visual statistical learning and anticipatory eye movements. Sometimes academic.

Articles & links

I have not read it, yet, but this looks like it might be interesting. (One of the authors posted it to Twitter.) arxiv.org/abs/2606.19317 They replaced attention heads with human-readable Python code snippets(?)

[2606.19317] Explaining Attention with Program Synthesis arxiv.org
AI Weekly's analysis
  • Under 1,000 LM-generated programs reproduce attention patterns in GPT-2, TinyLlama-1.1B and Llama-3B with above 75% average IoU on TinyStories.
  • Replacing 25% of attention heads with the synthesized programs raised average perplexity by only 16% while keeping downstream question-answering performance.
  • The pipeline computes a head's attention matrices, prompts a pretrained LM to write Python that reproduces them, then re-ranks by held-out accuracy.
Read full analysis →
View on Bluesky · ♥ 0 ↻ 0 ↩ 1 · 3 from the directory shared this · 9d ago
Andrea Lathrop reposted
Mark Riedl @markriedl.bsky.social

Everyone should read this, just to see how they implemented a perceptron (a very basic neural network) in Age of Empires II arxiv.org/abs/2605.31514 The artificial neurons pass activation energy in the form of goats.

If LLMs Have Human-Like Attributes, Then So Does Age of Empires II arxiv.org
AI Weekly's analysis
  • Adrian de Wynter argues LLM anthropomorphic attributes are empirically non-unique, using Age of Empires II as a counterexample.
  • De Wynter proves Age of Empires II is functionally and Turing-complete, making it a formal stand-in for LLM behavioral claims.
  • The paper proposes a 'null assumption': treating LLM non-uniqueness as the experimental baseline rather than assuming human-like attributes.
Read full analysis →
View on Bluesky →

Recent commentary

My Twitter timeline is full of Google guys announcing they are leaving Google for Anthropic, Anthropic guys going to OpenAI, OpenAI guys going to Google or Meta, and Meta guys going, "Save us, we are in hell!"

View on Bluesky · ♥ 14 ↻ 3 ↩ 0 · 19d ago

Do I detect a shift in the Force from AI back to cybernetics? 🤔🧐

View on Bluesky · ♥ 6 ↻ 3 ↩ 3 · 2d ago

One flavor of AI hype I strongly dislike (and is happening on Twitter, today, to some extent. This is a subtweet) is in which a known insider makes a sensational, breathless assertion about the current state of AI capability, which then gets credulously re-broadcast, assumed true... gets pushback...

View on Bluesky · ♥ 8 ↻ 3 ↩ 1 · 16d ago

I really need to stop letting Anthropic press releases capture my attention in any way.

View on Bluesky · ♥ 8 ↻ 0 ↩ 1 · 1d ago

I am doing this backwards, reading the Dehaene and the Eleos group's responses to the Anthropic J-space claims, before I go read the Anthropic paper, and that's probably not a good way to do it, but I am.

View on Bluesky · ♥ 5 ↻ 0 ↩ 0 · 2d ago

My Twitter timeline is full of people announcing new AI or AI-related startups.

View on Bluesky · ♥ 1 ↻ 0 ↩ 2 · 14d ago

"We believe the future of AI is a collective of modules interacting and coordinating..." Yeah, that's also the past of AI. That's just Minsky.

View on Bluesky · ♥ 5 ↻ 0 ↩ 0 · 16d ago

Alright... I was planning to sort of live-tweet my thoughts on the Anthropic J-space thing, after reading the responses, but... sorry... is the 'global workspace' they 'found' just the residual stream, which is, by definition, a... global... workspace...? (Or am I missing something?)

View on Bluesky · ♥ 2 ↻ 0 ↩ 1 · 1d ago

I've lost the link (I'll find it and add it to the replies below) but someone on Twitter made this banger phrasing I want to luxuriate in: "What has really happened is VC built the wrong AI."

View on Bluesky · ♥ 2 ↻ 0 ↩ 1 · 3d ago

I don't see how selling AI inference retail, and then selling a small % of vastly overvalued stock back to the government aligns with the stated goal of 'benefiting all of humanity.'

View on Bluesky · ♥ 2 ↻ 1 ↩ 0 · 6d ago

In Andrea Lathrop's orbit

Center = Andrea Lathrop. Left = members they follow (green edges). Right = members who follow them (blue edges). Top = mutual follows (orange edges, slightly larger). Drag any node to reposition; click to open that profile.