New benchmark exposes LLM failures in election information mediation
Researchers have formalized the first standardized benchmark for assessing how responsibly language models mediate political information during elections. Polistemics grounds evaluation in epistemic modesty, a principle centered on preserving citizen agency rather than treating LLM outputs as neutral information reproduction. Testing across three leading models on 2025 German and Dutch elections reveals that aggregate performance metrics obscure systematic failures in handling noisy or contradictory information. This work signals a shift in how the field measures LLM behavior in high-stakes civic contexts, moving beyond capability benchmarks toward accountability frameworks that matter to democratic institutions.68
