Reasoning without Gold Standards: A Proxy-Judge Theory of Autoformalization

The deeper provocation here is not about autoformalization specifically but about evaluation philosophy: the paper argues that proxy judges built from structured property checks can substitute for gold-standard reference solutions across any open-ended reasoning domain, which is a claim about measurement theory as much as it is about formal proof.

This connects directly to the graph isomorphism paper covered the same day ('Detecting Differences Is Not Understanding Structure'), which exposed how benchmark scores can be systematically misleading when evaluation design fails to probe the right properties. Both papers are circling the same underlying problem: current evaluation methods reward surface-level pattern matching rather than genuine structural correctness. The proxy-judge framework proposed here is essentially an attempt to build evaluation instruments that are harder to game by construction. The DecSelfMask paper from the same day also touches adjacent territory, using model-driven signal extraction as a substitute for expensive human annotation, which is the same resource-scarcity pressure driving reference-free evaluation in formal reasoning.

If a major formal verification benchmark adopts property-based proxy scoring within the next twelve months and published results show lower variance across model families than exact-match scoring, that would validate the core claim. If adoption stays confined to the original authors, the framework likely lacks the tooling to generalize.