paper web signal

RuleTrek: 11 Frontier LLMs Top Out at 55% on Distributed Rule Reasoning

Summary

Enterprise AI agents must constantly apply rules from policy documents, tax codes, and procurement guidelines that are spread across multiple files—exactly the scenario RuleTrek tests. Every frontier model fails substantially (26–55% end-to-end), exposing a gap that existing benchmarks, which present rules inline, miss entirely.