What Is the Minimum Architecture for Prolepsis? Early Irrevocable Commitment Across Tasks in Small Transformers

Researchers replicated findings on how small transformers (Gemma 2B, Llama 3.2 1B) make early, irreversible commitments to decisions. Using mechanistic analysis, they identified specific attention heads that sustain these commitments across layers and found planning requires ≤16 layers but commitment needs deeper architecture.

MentionsGemma 2 · Llama 3.2 · Lindsey

Modelwire summarizes — we don’t republish. The full article lives on arxiv.org. If you’re a publisher and want a different summarization policy for your work, see our takedown page.