Nature Human Behaviour maps LLMs' four roles in social science

A Nature Human Behaviour review published October 26 argues that large language models now play four distinct roles in computational social science research: as subjects that simulate human behaviour, assistants that automate analysis, collaborators that generate hypotheses, and evaluators that audit and improve research quality.

The review, led by Fengli Xu and James Evans with colleagues at Tsinghua University, HKUST and Microsoft Research Asia, spans sociology, political science, psychology, anthropology and economics. The authors frame the moment as recursive: "As artificial intelligence reshapes human society, understanding this transformation requires the very tools driving it."

They do not treat the shift as uncomplicated. LLMs "struggle with causal inference" and raise "urgent ethical concerns about privacy and misinformation," and their "ability to reproduce social complexity remains uneven and unproven."

Two researchers we track were already passing the paper around by the time it hit our feed. Announcing the piece on X, Evans said the thread covered "where the field is fooling itself" — an unusually candid framing to open a review article with.