Coding agents fail on repository tasks due to coherence debt, not context limits
Source published ·Modelwire updated
Original coverage: arXiv cs.LG ↗·How Modelwire adds context
The development
A new study quantifies how coding agents fail at repository-scale tasks by modeling the problem as a graph of interdependent facts that must stay coherent across edits. Researchers tested seven models across five different harnesses, systematically removing access to recent context or learned parameters to isolate failure modes. The key finding: whether a required fact is available in the prompt or memorized determines success or failure, while its distance from the agent's current position is irrelevant. When models encounter unfamiliar APIs or library changes, they collapse uniformly at the same point. This work exposes a fundamental architectural constraint in agentic coding systems and suggests that scaling context windows alone won't solve coherence problems without addressing how agents retrieve and maintain coupled dependencies.
Modelwire’s AI-generated summary of coverage from arXiv cs.LG.
Modelwire analysis
ExplainerOur AI-generated reading of the wider context and the next developments to watch.
The study's core insight is architectural, not empirical: it shows that repository-scale failures stem from a retrieval problem (whether facts are accessible), not a distance problem. This inverts the common assumption that longer context windows solve agentic reasoning at scale.
This connects directly to the August gradient bottleneck work, which also challenged an assumed architectural constraint by isolating what actually limits performance. Both papers use causal intervention to separate forward-pass geometry from what practitioners blame. The coherence-debt framing also echoes the distillation paper's finding that origin relationships (here, whether a fact lives in prompt or parameters) matter more than surface-level metrics. Together, these suggest the field is converging on a pattern: blamed bottlenecks often misdirect attention from retrieval and dependency structure.
If teams building coding agents adopt coupled-fact-graph modeling as a standard design pattern within the next 12 months, that signals the paper moved from diagnosis to practice. Alternatively, if a major model release announces architectural changes to fact retrieval (rather than context scaling) in response to this work, that confirms the finding has shifted how practitioners think about agentic design.
This interpretation is generated from the summary above and the archive coverage cited below. Our methodology · Report an error
Coverage behind this analysis
These archive entries ground the connection in our analysis. They are ordered by source publication date, with links to our coverage and the original sources.
·arXiv cs.CL
Causal study questions LM head gradient bottleneck hypothesis
Researchers challenge a widely cited claim that the language-model head creates a gradient bottleneck during backpropagation. Using causal intervention techniques, they isolate the backward pass from forward-pass geometry and find that reducing gradient rank actually harms training more than reducing forward-pass rank. This suggests the bottleneck hypothesis may be overstated, with implications for how practitioners…
Mentionscoding agents · repository-scale tasks · coupled-fact graph · parametric memory
How this coverage is produced
Modelwire uses AI to generate summaries and context from source headlines, snippets, and selected archive coverage. Automated checks do not verify every claim, and items are not routinely reviewed by a person before publication. Zacaria Solis operates the site. Read the linked source for the full evidence and report errors through our corrections process.
Modelwire summarizes, we don’t republish. arXiv cs.LG originally reported this story as “The Working Set of a Coding Agent: Coherence Debt in Repository-Scale Tasks”. The full content lives on arxiv.org. If you’re a publisher and want a different summarization policy for your work, see our takedown page.