paper web signal

Branching: A Third Transformer Scaling Axis With 51% Throughput Gain

Summary

Width and depth are the two canonical transformer scaling knobs; this paper proposes branching — parallel composition of full transformer blocks — as a third, backed by scaling laws and H200 hardware benchmarks. The 51% throughput gain and 34% KV-cache cut are concrete, reproducible claims that will drive immediate follow-on work across labs.