LLMs match expert performance on cancer research evidence synthesis

The study doesn't just show LLMs match experts on accuracy; it tests whether they can perform the intermediate step that production systems routinely fail at: grounding answers in specific evidence passages rather than generating fluent but unverifiable synthesis. This is the same bottleneck LitTraceQA exposed in August.

This research directly addresses the grounding problem that LitTraceQA benchmarked earlier this month. Where LitTraceQA revealed that RAG systems often disconnect answers from source passages, this oncology study validates that frontier models can now perform that middle step reliably in a high-stakes domain. The connection matters because it suggests the gap identified in scientific QA may be closing for specific use cases, though the microbial oncology scope is narrow enough that generalization remains an open question.

If Google or OpenAI announce a production literature review tool using these models within the next six months, and if that tool's grounding accuracy on held-out oncology papers matches the benchmark results, then this transitions from validation to deployment. If the same accuracy doesn't hold on papers published after the training cutoff, contamination or domain specificity is the likely culprit.