Arxiv 'You Don't Need Long Context' Paper Finds 3.6-7x Cost Savings From Compaction With <3.7pp Accuracy Loss

A new arXiv paper argues frontier LLMs can match long-context accuracy with much shorter windows using two compaction strategies: End-of-Conversation Compaction (EoCC) and Single-Action Compaction (SAC), keeping accuracy within -3.7 to +5.6 pp of full-history baselines while yielding 6.5-54.6x cost savings on long-input tasks. The authors show generating at 256K context costs 3.6-7x more than 16K on frontier models. Introduces Semantic State Space Models (SSSMs) that maintain compact natural-language state, and evaluates across Claude Opus 4.5, GPT-5.6 Sol, GLM 5.2, Kimi K2.6, Qwen, Gemma 4 on SWE-bench, Terminal-Bench 2.1, LongBench v2 and LOONG.