LLMs retrieve financial data but ignore it in investment decisions

The study isolates a specific failure mode that better retrieval alone cannot fix. The critical insight is that LLMs can locate relevant risk information in 10-Ks but systematically downweight it as context expands, suggesting the problem lives in how models integrate signals across long sequences, not in what they can find.

This connects directly to the memory-architecture work from late August (Recuris paper on working vs. experiential memory). Both identify a core scaling bottleneck: systems that work at small scale break when context or history grows. But where Recuris proposes separating memory layers to preserve task focus, this financial research study shows that separation alone may not solve integration failures. The two findings together suggest that length-robust judgment requires more than better memory organization; it may demand changes to how models weight retrieved information during reasoning.

If the same research team or others demonstrate that explicit integration prompts (asking the model to 'explain how this risk affects your valuation') recover the lost signal in long contexts, that would point toward a training/instruction gap rather than an architectural one. If the signal loss persists even with such prompts, it confirms a deeper limitation in how transformers process long sequences for judgment tasks.