Interleaved Speech Language Models Latently Work In Text

The finding inverts a common assumption: these models were not learning to 'hear' in any meaningful acoustic sense, but were quietly routing through text representations the entire time. That has direct consequences for how we evaluate claimed speech understanding versus what is actually a text-mediated lookup.

This connects to a broader pattern in recent coverage around what models are actually doing internally versus what their interface implies. The 'Sub-Billion, Super-Frontier' piece from the same day raised a parallel question about whether scale-driven capability claims hold up under scrutiny, and the answer there was that fine-tuned small models were doing something structurally different than assumed. Here the same skeptical lens applies to multimodal architecture: the speech capability is real in output terms, but the internal mechanism is closer to a transcription pipeline than acoustic reasoning. That distinction matters for anyone designing or auditing speech-language systems, because it suggests the failure modes and the interpretability tools needed are fundamentally text-side problems.

Watch whether teams building speech-language models begin publishing ablations that deliberately suppress the intermediate text representations, to test whether acoustic performance degrades proportionally. If it does, the 'latent transcription' framing is confirmed and the field will need to revisit how speech benchmarks are designed.