Tom McCoy: 🤖🧠NEW PAPER🧠🤖 (The result of an 8-year project!) LLMs seem very different from symbolic systems. Yet LLMs excel in symbolic domains (e.g., language/code/math). How do they do it? Our finding: LLM r…
Tom McCoy: Paper: arxiv.org/abs/2608.29530 We consider a variety of neural networks that perform seemingly-symbolic tasks, from small-scale models trained on simple list-manipulation tasks to LLMs performing …
Tom McCoy: Our hypothesis: The networks succeed on these tasks by implicitly building symbolic structure in vector space. What makes this hypothesis testable is the Tensor Product Representation (TPR) formali…