Categorical Prior Lock-in: Why In-Context Learning Fails for Structured Data
Source published ·Modelwire updated
Original coverage: arXiv cs.LG ↗·How Modelwire adds context
The development
Researchers have identified a fundamental constraint in how large language models adapt to new data distributions through in-context learning. When faced with rare categories in structured datasets, LLMs hit a hard ceiling: they reproduce the categorical priors baked into pre-training and cannot update them with new examples, even as numerical accuracy improves. This failure mode, termed categorical prior lock-in, exposes a gap between ICL's theoretical flexibility and practical performance on tabular data. Parameter-efficient fine-tuning like LoRA sidesteps the problem, suggesting that true adaptation to out-of-distribution structured data may require weight updates rather than prompt-based approaches. The finding matters for practitioners deploying LLMs as conditional generators and signals that ICL alone is insufficient for production systems handling imbalanced or novel categorical distributions.
Modelwire’s AI-generated summary of coverage from arXiv cs.LG.
Modelwire analysis
ExplainerOur AI-generated reading of the wider context and the next developments to watch.
The key distinction the summary gestures at but doesn't fully land: this isn't about LLMs being bad at tables generally, it's about the asymmetry between how ICL updates numerical versus categorical representations. Numerical priors can shift with examples; categorical priors appear to be frozen at the weight level, making the failure invisible until you hit a rare class.
This connects directly to the tension surfaced in the Chronos-2 coverage ('Time-Series Foundation Model Embeddings for Remaining Useful Life Estimation') from the same day, where frozen embeddings performed well precisely because the task stayed within the model's distributional comfort zone. Categorical prior lock-in is what happens when you push outside that zone and expect prompt-based adaptation to compensate. Both papers, read together, suggest a cleaner mental model: foundation models transfer well when the target distribution resembles pre-training, and degrade in specific, predictable ways when it doesn't. The LoRA finding here adds a practical corollary: the fix requires touching weights, which changes the deployment calculus significantly for teams that chose ICL specifically to avoid fine-tuning overhead.
Watch whether any tabular-focused benchmarks (TabPFN evaluations, for instance) begin reporting categorical rare-class accuracy separately from overall metrics in the next two quarters. If they do, this paper will have shifted how the field measures ICL progress on structured data.
This interpretation is generated from the summary above and available source metadata. Our methodology · Report an error
MentionsLarge Language Models · In-Context Learning · LoRA · Tabular Data
How this coverage is produced
Modelwire uses AI to generate summaries and context from source headlines, snippets, and selected archive coverage. Automated checks do not verify every claim, and items are not routinely reviewed by a person before publication. Zacaria Solis operates the site. Read the linked source for the full evidence and report errors through our corrections process.
Modelwire summarizes, we don’t republish. The full content lives on arxiv.org. If you’re a publisher and want a different summarization policy for your work, see our takedown page.