LLMs over-edit code repairs, adding unnecessary complexity despite high accuracy
Frontier LLMs tasked with code repair exhibit a systematic flaw: they over-edit, rewriting far more than necessary to fix bugs. Researchers constructed a controlled benchmark using 400 problems with known minimal patches, revealing that even top performers like GPT-5.5 produce unnecessarily large edits that add cognitive load for reviewers. A simple preservation instruction cuts excess edits by 33 percent, suggesting that alignment toward minimal intervention remains an open frontier in code generation. This matters for production deployments where maintainability and code review velocity directly impact engineering velocity.
Modelwire context
ExplainerThe paper isolates a specific failure mode (over-editing) rather than general code quality, and shows it's addressable through a simple instruction-level fix. The novelty isn't that models make mistakes, but that they make predictable, unnecessary ones that scale with model capability rather than task difficulty.
This connects directly to the mechanistic evaluation work from early September. Just as researchers reverse-engineered how LLM judges make decisions (the Themis/Prometheus analysis), this work reverse-engineers why code models make unnecessary changes. Both expose internal decision-making that looks reasonable at aggregate level but breaks down under scrutiny. The preservation instruction parallels findings from the SFT-RL budget allocation work (early September): small, targeted interventions often outperform brute-force approaches. Code review velocity is a production constraint, much like annotation budgets are.
If OpenAI ships a preservation instruction variant in GPT-5.5's next update and independent benchmarks on BigCodeBench show sustained 30%+ reduction in edit volume without accuracy loss, the finding generalizes. If the effect degrades below 15% reduction within two model versions, it's likely a brittle alignment artifact rather than a fundamental insight about code generation.
Coverage we drew on
This analysis is generated by Modelwire’s editorial layer from our archive and the summary above. It is not a substitute for the original reporting. How we write it.
MentionsGPT-5.5 · BigCodeBench · OpenAI
Modelwire Editorial
This synthesis and analysis was prepared by the Modelwire editorial team. We use advanced language models to read, ground, and connect the day’s most significant AI developments, providing original strategic context that helps practitioners and leaders stay ahead of the frontier.
Modelwire summarizes, we don’t republish. arXiv cs.CL originally reported this story as “When Models Edit Too Much: On the Fidelity of Minimal Code Edits”. The full content lives on arxiv.org. If you’re a publisher and want a different summarization policy for your work, see our takedown page.