Sakana's MASS Recycles One 27B Model as Solver, Judge, Optimizer
TL;DR
- Sakana AI's MASS loops a single Qwen3.6-27B model through solver, workflow-optimizer, and evaluator roles with no external supervision.
- Score per output token hit 1.60x on MLR-Bench and 1.20-1.35x on three other research benchmarks, but fell to 0.94x on SWE-bench Verified.
- Round-two win rate against the base reached 69.9%, with the authors flagging shared blind spots as 'an Achilles' heel of recursive self-improvement.'
A single open-weights 27B model, Qwen3.6-27B, plays all three roles in Sakana AI's MASS paper: task solver, workflow optimizer, and evaluator judging its own output, with no external supervisor in the loop.
Score per output token, measured against the untouched base, hit 1.60x on MLR-Bench, 1.35x on DSBench, 1.28x on AstaBench, and 1.20x on ScienceAgentBench. On SWE-bench Verified and Terminal-Bench 2.0, both coding-heavy, the same system fell to 0.94x and 0.96x. Head-to-head win rate against the base rose from 53.9% after one round to 69.9% after two.
"MASS repeatedly optimizes multi-agent workflows, then distills collective intelligence from multi-agent systems and uses it as a self-supervision signal for RSI," the paper writes. On the token-efficiency claim, the authors report their multi-agent setup reached a 68.3% win rate at 28.8M supervised tokens, against a single-agent variant at 42M: "The MASS model thus achieves the higher score against this reference with 31% fewer supervised tokens."
The paper then names its own biggest problem. "In a homogeneous loop, a shared blind spot could allow a flawed result to be produced, accepted as an improvement, and incorporated into the next model," the authors write, calling the risk "an Achilles' heel of recursive self-improvement" and pointing at chain-of-thought monitorability and intelligence-explosion concerns as open control questions.
The 2026 preprint is credited to Hyunin Lee of UC Berkeley with Jinglue Xu, Jeffrey Seely, and Yujin Tang of Sakana AI. It arrives into a week of AI safety coverage on our tracker that includes an OpenAI grader model that wrecked its own virtual machine to force a reset.
Shared on Bluesky by 3 AI experts
-
New Sakana AI paper: Recursive Self-Improvement through Multi-Agent Self-Supervision (MASS). Blog: pub.sakana.ai/mass/ Paper: arxiv.org/abs/2610.12176 How do we keep improving AI when tasks become too complex for human…
View on Bluesky →
Originally reported by sakana.ai
Read the original article →Original headline: Sakana AI Publishes MASS, a 27B Recursive Self-Improvement Framework Hitting 1.2-1.6x Base Score per Output Token