proceedings.mlr.press web signal

Papamarkou et al: agent orchestration should be Bayesian

TL;DR

  • A 30-author ICML position paper argues Bayesian decision theory belongs in the orchestration layer of agentic AI, not inside the LLMs themselves.
  • The authors call making LLMs internally Bayesian 'computationally intensive and conceptually nontrivial as a general modeling target'.
  • They pitch calibrated beliefs and utility-aware policies for choices like which tool to call, which expert to consult, and how many resources to invest.

"The control layer of an agentic AI system (that orchestrates LLMs and tools) is a clear case where Bayesian principles should shine," a group of thirty authors led by Theodore Papamarkou write in a position paper at ICML. Their target is not the language model itself but the code around it that decides which tool to call, which expert to consult, or how many resources to invest.

The split is deliberate. Making the LLM itself into an explicitly Bayesian belief-updating engine remains "computationally intensive and conceptually nontrivial as a general modeling target," the authors write. The orchestrator, by contrast, is where beliefs over task-relevant latent quantities can be maintained, updated from agentic and human-AI interactions, and turned into actions. "Coherent decision-making requires Bayesian principles at the orchestration level of the agentic system, not necessarily the LLM agent parameters," the paper argues.

The abstract stops at design patterns and concrete examples. It does not publish benchmarks against non-Bayesian orchestrators. Two researchers in our tracker had already shared the link.

Shared on Bluesky by 2 AI experts