27B math model cuts Mathlib overlap from 91.9% to 30.6%
TL;DR
- The authors define intrinsic interestingness as the ratio of proof length to statement length and argue it correlates with downstream utility.
- Their 27B model is reported to predict proof difficulty more accurately than frontier general-purpose models.
- Optimizing for the metric drops substantial-or-full Mathlib overlap from 91.9% to 30.6%, which the authors read as more out-of-distribution math.
Niket Patel, Julia Kempe and their coauthors want a computable answer to the question of whether an AI-generated theorem is worth anything. In a preprint posted to arxiv, they define "intrinsic interestingness of a theorem as the ratio between the length of its proof and the length of its statement," and report that it "correlates strongly with an extrinsic measure of the downstream utility of a theorem."
To operationalize the metric, the team trains a 27-billion-parameter model to predict proof difficulty conditioned on a set of premises. The abstract claims this system "predicts proof difficulty more accurately than frontier general-purpose models," though it does not name which frontier models were tested or by what margin.
The headline number is a shift in what the system generates. Optimizing for the interestingness score reduces "substantial or full overlap with Mathlib from 91.9% to 30.6%," which the authors read as evidence of "the creation of more out-of-distribution math" rather than a system that keeps rediscovering the standard Lean library.
The paper is direct about the ambition. Its framework, the authors write, "provides a path towards self-expanding, machine-verified mathematical libraries that can choose worthwhile statements without relying on human-supplied targets."
Originally reported by paper
Read the original article →Original headline: 27B Math Model Cuts Mathlib Overlap From 92% to 31% Via Proof/Statement-Length Interestingness Metric