User expectations, not model quality, drive LLM satisfaction ratings

The sharpest implication the summary underplays is that feedback loops feeding model development priorities may be systematically corrupted: if user satisfaction scores reflect landing page copy more than output quality, then teams optimizing for those scores are chasing perception management, not capability improvement.

This connects directly to the July 1 arXiv paper 'Quantifying the Affective Gap,' which found that benchmark performance and real-world deployment quality diverge in emotion classification tasks. That paper exposed a gap between how models are validated before release and how they actually perform; this new study adds a second layer by showing that even post-release user evaluations are unreliable signals. Together they describe a measurement problem that runs the full product lifecycle, from pre-release benchmarking through post-launch satisfaction scoring. The persona instability findings from 'Persona Non Grata' (also July 1) compound this further: if model behavior is inconsistent across interaction dimensions, and users are rating expectations rather than outputs, organizations have almost no clean signal left to work with.

Watch whether any major AI product team publicly revises its user satisfaction methodology or separates expectation-setting controls from performance metrics in the next two quarters. If none do, that itself confirms how entrenched perception-based scoring is in current product development cycles.