Computerphile
https://www.youtube.com/user/Computerphile · Editorial weight 8/10
Clever Hans & AI Music Classification - Computerphile
Researchers at King's College London are investigating whether AI music classification systems rely on genuine learned features or exploit spurious correlations, drawing parallels to Clever Hans, the famous horse whose apparent mathematical ability masked reliance on subtle observer cues. This work probes a critical vulnerability in deployed audio models: the gap between benchmark performance and actual feature learning. The findings matter for practitioners deploying music AI in production, as systems may appear competent while operating on brittle, non-generalizable patterns. Understanding these failure modes is essential as audio classification expands into high-stakes domains like content moderation and rights management.