paper web signal

Every One of 16 RSI Agent Harnesses Gains and Loses Tasks Simultaneously—Top Score Never Predicts Best Gain

Summary

An empirical audit of four RSI methods across 16 evolved harnesses finds that every single agent gains tasks while losing others, the highest benchmark score never correlates with the largest mean improvement, and most reliability gains raise deployment cost—directly challenging the reliability narrative around harness-based recursive self-improvement.