Research·arXiv cs.CL·2d ago

LLMs fail to capture individual variation in large-scale persona study

A large-scale empirical study reveals a fundamental limitation in using LLMs as human surrogates: while models accurately predict aggregate survey responses, they capture only 3% of individual variation compared to a 54% human retest benchmark. The finding persists across 400,000+ participants and 6,000+ items, and richer persona data, model variants, and fine-tuning fail to close the gap. This challenges the premise that LLMs can meaningfully substitute for or explore individual human behavior, signaling that aggregate alignment masks poor individual-level fidelity and reshaping expectations for LLM use in behavioral research and personalization.

Modelwire context

Explainer

The study isolates a specific failure mode: LLMs can memorize population-level patterns without capturing the idiosyncratic variation that makes individual prediction meaningful. This isn't about factual knowledge or safety, but about whether models can function as behavioral proxies at all.

This finding sits alongside a cluster of August research exposing gaps between surface-level performance and actual capability. Like the essay-scoring audit that showed agreement metrics mask systematic biases, or the chain-of-thought work revealing models verbalize commitment to cues they don't actually use, this paper demonstrates that aggregate alignment creates false confidence. The pattern across these studies is consistent: when you measure what actually matters (individual fidelity, rating consistency, reasoning transparency), current models underperform their headline metrics. For teams building personalization systems or behavioral research tools, the implication is the same: validation frameworks built on population-level agreement are insufficient.

If researchers apply the same 3% vs. 54% benchmark to proprietary closed-weight models (GPT-4, Claude 3.5) and find similar gaps, that confirms this is a fundamental architectural constraint rather than a scaling artifact. If the gap narrows meaningfully with models trained on individual-level behavioral data (not just aggregate corpora), that signals a path forward; if it doesn't, that's the real story.

Coverage we drew on

LLM Judges as Raters: A Pre-Registered Audit of Severity, Halo, Reliability, and Version Instability in LLM Essay Scoring on Public Corpora · arXiv cs.CL

This analysis is generated by Modelwire’s editorial layer from our archive and the summary above. It is not a substitute for the original reporting. How we write it.

MentionsLLMs

Read full story at arXiv cs.CL →(arxiv.org)

Modelwire Editorial

This synthesis and analysis was prepared by the Modelwire editorial team. We use advanced language models to read, ground, and connect the day’s most significant AI developments, providing original strategic context that helps practitioners and leaders stay ahead of the frontier.

Our mission How we write

Modelwire summarizes, we don’t republish. arXiv cs.CL originally reported this story as “Item-Mean Surrogates: Why Richer Persona Data Fail to Improve LLMs as Human Surrogates”. The full content lives on arxiv.org. If you’re a publisher and want a different summarization policy for your work, see our takedown page.