nature.com web signal

Stanford's Paper2Agent converts papers into working AI agents

TL;DR

  • Stanford Medicine's Paper2Agent turned 74 of 100 bioRxiv computational biology papers into working AI agents, with 593 of 599 generated tools passing automated validation.
  • Paper agents scored 91.2% accuracy on 300 benchmark questions versus 80.3% for a Claude-plus-repository baseline; an AlphaGenome agent was built in about 45 minutes for roughly $14 in compute.
  • Two paper agents collaborating on an ADHD genome-wide association dataset flagged a variant near the gene MPHOSPH9 that senior author James Zou said had not been reported before.

Stanford Medicine's Paper2Agent, published in Nature on Sept. 16, converts a scientific manuscript along with its data and code into an AI agent that answers questions about the paper and runs its methods on new datasets. A prototype turned 74 of 100 bioRxiv computational biology papers into working agents, with 593 of 599 generated tools passing automated validation.

Across 300 benchmark questions drawn from those 100 papers, the paper agents scored 91.2% accuracy, ahead of a Claude-plus-repository baseline at 80.3%. The team built an AlphaGenome agent in about 45 minutes for roughly $14 in compute and reported it beat the Biomni biomedical agent on genetics questions. Further demonstrations were built from Scanpy and TISSUE.

"An MCP lets AI essentially represent a paper PDF in a form that's easy for agents to access, almost like a filing system," senior author James Zou told the Stanford Report, describing the Model Context Protocol servers that the pipeline constructs. Lead author Jiacheng Miao worked with Joe R. Davis, Yaohui Zhang and Jonathan K. Pritchard on the framework.

The team also pointed two paper agents at each other. A genome-prediction agent applied its methods to a genome-wide association dataset for attention-deficit/hyperactivity disorder and flagged a variant near the gene MPHOSPH9 as linked to ADHD risk, a connection Zou said had not been reported before.

Zou described the ambition in broad terms: "This is an opportunity to fundamentally reimagine what knowledge looks like. Instead of having only passive artifacts, why don't we convert each static record into an active embodiment of knowledge?" He added that it is "still important to attribute the final discoveries and reference them back to original papers and original human authors."

Shared on Bluesky by 3 AI experts