nature.com web signal

Nature review casts LLMs in four social-science roles

TL;DR

  • A Nature Human Behaviour review frames large language models as playing four roles in computational social science: subjects, assistants, collaborators, and evaluators.
  • The authors flag that LLMs 'struggle with causal inference' and raise urgent ethical concerns about privacy and misinformation.
  • Their capacity to reproduce social complexity is described as 'uneven and unproven,' not a solved problem.

A new Nature Human Behaviour review argues that large language models have taken up four distinct jobs inside computational social science. The authors frame it plainly: LLMs now serve as 'subjects that simulate human behaviour, assistants that automate analysis, collaborators that generate hypotheses and evaluators that audit and improve research quality.'

The second half of the abstract is blunter. 'LLMs struggle with causal inference and raise urgent ethical concerns about privacy and misinformation, and their ability to reproduce social complexity remains uneven and unproven,' the authors write. Causality, privacy, misinformation, and fidelity to human behaviour sit in the same sentence, unresolved.

Two of the computational social scientists we keep tabs on passed the review's link along, which is roughly how a taxonomy paper like this one tends to travel once it lands.

Shared on Bluesky by 2 AI experts

  • Robert Hawkins @rdhawkins.bsky.social amplified

    @gutlin.bsky.social

    Large language models for computational social science www.nature.com/articles/s41...

    View on Bluesky →
  • Scott McGrath @smcgrath.phd amplified

    @richardjeanso.bsky.social

    Smart & helpful new paper in Nature Human Behavior on generative AI & social sciences which explores gen AI models as both novel tools for discovery and analysis, as well as objects of study - the latter thus esp insight…

    View on Bluesky →