⚡ 11 h early
LLM social science validation epistemic paper
Validating LLMs in social science: Epistemic threats and emerging norms
3 experts are actively discussing the implications.
2 experts
1 community
1 sources clustered
“There's lots more in our paper (arxiv.org/abs/2607.07915), including our complete annotation scheme, and the data itself is available on OSF: osf.io/ab5zc/overvi...”
3 experts discussed this · 19 posts
Dallas Card: As some may have heard me talk about at #ACL2026, I'm excited to share a new preprint on approaches to validation when using LLMs to measure concepts in social science, led by @madesai.bsky.social …
Dallas Card: Social scientists have long used a variety of approaches to get quantitative measurements of fuzzy concepts like "ideology", including human coding and supervised learning. Unsurprisingly, there ha…
Dallas Card: In this paper, we survey what has so far been published in eight top social science journals (2022-2025), and assess how researchers are using LLM as measurement instruments, how they are defining …
Open the full discussion →