Stanford's Paper2Agent turns 74 of 100 papers into AI agents
TL;DR
- Paper2Agent converted 74 of 100 bioRxiv computational biology papers into working AI agents; 593 of 599 generated tools passed automated validation.
- The paper agents scored 91.2% on 300 benchmark questions drawn from those papers, versus 80.3% for a Claude-plus-repository baseline.
- The framework converts a paper and its codebase into a Model Context Protocol server, callable from any MCP client such as Claude Code.
A Stanford team ran an automated pipeline over 100 bioRxiv computational biology papers, and 74 of them came out the other end as working AI agents. The system, called Paper2Agent, generated 599 tools from those papers; 593 passed automated validation. The resulting agents scored 91.2% across 300 benchmark questions drawn from the papers themselves, against 80.3% for a Claude-plus-repository baseline. The work appears in Nature, published 16 September.
The pipeline converts a paper and its codebase into a Model Context Protocol server. Any MCP-compatible client, such as Claude Code, can then call the paper's methods through natural language. The authors describe each output as a "virtual corresponding author" whose manuscript, supplementary materials, datasets, code and workflows sit on the server "as active, agent-native knowledge rather than static text."
Miao, Zou and colleagues built demonstration agents for AlphaGenome, Scanpy and TISSUE. According to a technical write-up on MarkTechPost, the AlphaGenome agent took about 45 minutes to build for US $14 in compute, and scored 98.7 ± 1.3% on tutorial-derived queries and 82.7 ± 2.4% on open-ended ones.
The paper frames the result as "a new mode of scientific communication, moving beyond static dissemination to interactive collaboration." The tested corpus is 100 papers from a single field, and the 300 benchmark questions were drawn from those same papers, so the accuracy figures leave room for a harder held-out evaluation. Five people in our Who's Who tracker posted the link within days of publication.
Shared on Bluesky by 5 AI experts
-
It would be fun to listen to a future episode of the Mystery AI Hype Theater 3000 podcast (that uses *ridicule as praxis") about this article 🤣 "Reimagining research papers as interactive and reliable AI agents" www.nat…
View on Bluesky →
Originally reported by nature.com
Read the original article →Original headline: Reimagining research papers as interactive and reliable AI agents - Nature