Content moderation benchmarks mask criterion-level failures in LLMs
A new evaluation framework reveals that LLMs achieving high scores on content moderation benchmarks often fail when assessed on individual criteria in isolation. Researchers introduced DECO, a factorization method that decouples moderation rules to test whether models genuinely understand each guideline or merely pattern-match on aggregated labels. Testing four LLMs across multiple datasets exposed significant criterion-level brittleness despite strong overall performance. This finding matters for deployment: systems trusted on benchmark results may harbor hidden vulnerabilities when real-world moderation demands precise, criterion-specific reasoning rather than holistic classification.62
