Post-answer confidence outperforms pre-answer estimates in LLM reliability

The paper's practical provocation is that most deployed confidence-routing systems are making decisions with the weaker signal. Pre-answer confidence is what RAG pipelines and tool-use routers currently act on, so the finding implies those systems are structurally miscalibrated by design, not by accident.

This connects directly to the Bielik activation dispersion work covered the same day, which showed that pre-output neural signals can separate known from unknown entities with near-perfect AUROC. That result looks more complicated in light of this paper: high pre-answer separability on entity familiarity does not necessarily mean the confidence estimate is well-calibrated for factual reliability. The two papers are probing adjacent problems from opposite directions, one arguing internal signals are informative before generation, the other arguing they are more trustworthy after. Together they suggest the field needs a cleaner taxonomy of what 'confidence' means at each stage of inference, rather than treating it as a single quantity.

Watch whether RAG benchmark suites like FRAMES or CRAG release splits that explicitly test routing accuracy under pre- vs post-answer confidence regimes. If post-answer signals produce measurably better retrieval decisions there, this finding moves from theoretical to operationally mandatory.