Paper2Agent converts 74 biology papers into working AI agents
TL;DR
- A Nature paper introduces Paper2Agent, a framework that converts research papers into interactive AI agents via Model Context Protocol servers.
- The pipeline automatically agentified 74 of 100 computational biology papers, producing 593 validated tools that hit 91.2% accuracy on benchmark questions.
- On the AlphaGenome paper, Paper2Agent generated 22 tools in 45 minutes at $14 cost, scoring 98.7% on tutorial queries and 100% on novel ones.
A Stanford-led team ran 100 computational biology papers through an automated pipeline and turned 74 of them into working AI agents without manual cleanup, according to a paper published in Nature on September 16.
The framework, called Paper2Agent, converts a paper's methods into a Model Context Protocol (MCP) server so its tools, resources, and workflows can be queried in natural language. On the AlphaGenome paper alone, authors Jiacheng Miao, Joe R. Davis, Yaohui Zhang, Jonathan K. Pritchard, and James Zou report that the pipeline generated 22 validated tools in 45 minutes at a cost of $14, hitting 98.7% accuracy on tutorial-derived queries and 100% on novel ones. Across the 100-paper set, 593 tools passed automated validation and the resulting agents answered benchmark questions at 91.2% accuracy.
The paper describes the shift as one "from a document or codebase encoding knowledge to a knowledgeable entity capable of execution and dialogue."
In one worked example, three separate paper-agents (AlphaGenome, MPRA-coupled scCRISPRi, and Perturb-seq) autonomously interacted to identify GPR137 as the probable causal gene at the rs887314 locus in psoriasis.
Roughly 26% of papers failed agentification, the authors report, typically because code was missing, documentation was incomplete, or environments could not be resolved. The paper proposes journals begin adding an "Agent availability" section alongside the usual data and code availability statements. Five of the researchers on our Who's Who list posted the link the same week.
Shared on Bluesky by 5 AI experts
-
It would be fun to listen to a future episode of the Mystery AI Hype Theater 3000 podcast (that uses *ridicule as praxis") about this article 🤣 "Reimagining research papers as interactive and reliable AI agents" www.nat…
View on Bluesky →
Originally reported by nature.com
Read the original article →Original headline: Reimagining research papers as interactive and reliable AI agents - Nature