Xu and Evans map four LLM roles across social science
TL;DR
- A Nature Human Behaviour review sorts LLMs in social science into four roles: subjects, assistants, collaborators and evaluators.
- Lead authors Fengli Xu and James Evans survey applications across sociology, political science, psychology, anthropology and economics.
- The review flags that LLMs struggle with causal inference and that privacy and misinformation concerns remain unresolved.
A Nature Human Behaviour review published on 26 October sorts large language models in social science into four research roles: 'subjects that simulate human behavior, assistants that automate analysis, collaborators that generate hypotheses, and evaluators that audit research quality.' The piece, led by Fengli Xu and James Evans with collaborators, surveys applications across sociology, political science, psychology, anthropology and economics.
Its framing is recursive. As society becomes 'saturated with artificial intelligence agents,' the authors argue, the same systems researchers use to study people are also becoming the people being studied. They call that bind 'a recursive challenge that will define the future of social science.'
The review is not a cheerleading piece. It says LLMs struggle with causal inference and that their capacity to reproduce social complexity remains uneven and unproven. Privacy and misinformation concerns stay unresolved.
Shared on Bluesky by 2 AI experts
-
Large language models for computational social science www.nature.com/articles/s41...
View on Bluesky → -
Smart & helpful new paper in Nature Human Behavior on generative AI & social sciences which explores gen AI models as both novel tools for discovery and analysis, as well as objects of study - the latter thus esp insight…
View on Bluesky →
Originally reported by nature.com
Read the original article →Original headline: Large language models for computational social science - Nature Human Behaviour