Skip to content
Modelwire
Subscribe

Why Sampling Is Not Choosing: Intentionality, Agency, and Moral Responsibility in Large Language Models

Source published ·Modelwire updated

Original coverage: arXiv cs.CL ↗·How Modelwire adds context

Illustration accompanying: Why Sampling Is Not Choosing: Intentionality, Agency, and Moral Responsibility in Large Language Models

The development

A philosophical paper challenges the growing narrative that large language models possess genuine agency or moral responsibility. The authors argue that LLMs operate through learned probabilistic mappings with only derived intentionality, not the intrinsic intentionality and commitment-bearing capacity required for moral agency. Stochastic sampling, they contend, produces variation but not authentic choice. This work matters for the AI landscape because it directly counters claims used to justify anthropomorphizing LLMs in policy and product discussions, potentially reshaping how regulators and builders frame accountability for model outputs.

Modelwire’s AI-generated summary of coverage from arXiv cs.CL.

Modelwire analysis

Explainer

Our AI-generated reading of the wider context and the next developments to watch.

The paper's sharpest contribution isn't the conclusion that LLMs lack agency (that's familiar territory) but the specific mechanism it targets: stochastic sampling is framed not as a weak form of choice but as categorically different from choice, which forecloses gradualist arguments that LLMs might have 'partial' moral status as they scale.

This connects most directly to the peer review novelty study we covered on June 11, which documented how promotional framing diverges from what evaluators actually find. That paper's concern about capability overclaiming in AI research is precisely the dynamic this philosophical work is trying to interrupt at the conceptual level, before inflated framing reaches policy. The MaxProof coverage is also relevant here: a system achieving gold-medal proof performance on IMO 2025 is exactly the kind of result that feeds anthropomorphizing narratives, and this paper provides the philosophical vocabulary to push back on those readings without dismissing the capability itself.

Watch whether any of the major AI policy frameworks currently in draft (EU AI Act implementing acts, NIST RMF updates) cite philosophical distinctions between intrinsic and derived intentionality when assigning accountability. If they don't engage with this level of conceptual precision by late 2026, the paper will have influenced academic discourse without touching the regulatory layer it's most relevant to.

This interpretation is generated from the summary above and the archive coverage cited below. Our methodology · Report an error

Coverage behind this analysis

These archive entries ground the connection in our analysis. They are ordered by source publication date, with links to our coverage and the original sources.

  1. ·arXiv cs.CL

    Examining the Cognitive Gap Between Authors and Peer Reviewers on Academic Paper Novelty

    Researchers analyzed 15,000+ peer-reviewed papers to quantify how author framing diverges from reviewer assessment of novelty. The study reveals reviewers apply broader evaluation criteria than authors' promotional language suggests, with promotional intensity effects varying by paper type. This work matters for AI because similar gaps between model capability claims and actual performance benchmarks plague LLM…

    Read Modelwire coverage →Original source ↗

MentionsLarge Language Models · LLMs

MW

How this coverage is produced

Modelwire uses AI to generate summaries and context from source headlines, snippets, and selected archive coverage. Automated checks do not verify every claim, and items are not routinely reviewed by a person before publication. Zacaria Solis operates the site. Read the linked source for the full evidence and report errors through our corrections process.

Modelwire summarizes, we don’t republish. The full content lives on arxiv.org. If you’re a publisher and want a different summarization policy for your work, see our takedown page.

Why Sampling Is Not Choosing: Intentionality, Agency, and Moral Responsibility in Large Language Models · Modelwire