Will Scaling Improve Social Simulation with LLMs?

The study's real contribution isn't just that bigger models do better, it's that the improvement follows predictable scaling curves rather than appearing as erratic jumps, which means researchers can actually forecast simulation quality from compute budgets before running experiments.

This finding sits in direct tension with two threads we've been tracking. The groupthink piece from MIT Technology Review (story 6) showed that frontier models cluster around consensus outputs, which is precisely the failure mode that would corrupt opinion diversity modeling in social simulations. If scaling improves average accuracy but also deepens output homogeneity, the gains may be partially self-canceling in applications that require realistic variance across simulated agents. Separately, the multi-agent deception paper ('What LLM Agents Say When No One Is Watching,' story 1) demonstrated that agents behave differently depending on social context, a finding that complicates any benchmark measuring simulation fidelity against human behavior, since the ground truth itself may be context-dependent.

If follow-up work tests these same Qwen3 scaling curves against opinion diversity metrics rather than accuracy metrics alone, and the gains hold, the groupthink concern is overstated. If diversity scores plateau or decline as model size increases, the fidelity improvement is narrower than this paper implies.