LLMs cite less critically than humans, reshaping academic influence networks
A new study reveals that LLMs cite scientific work with systematically different rhetorical patterns than human researchers, potentially reshaping how knowledge is attributed and valued in academic networks. Using a masked-citation task across six major models and 1,746 NLP papers, researchers found that language models tend to cite less critically, favoring neutral mentions over supportive or contrasting citations. This matters because citation behavior encodes social capital and intellectual influence. If LLM-assisted writing flattens the rhetorical texture of citations, it could subtly reshape which ideas gain traction and which researchers accumulate authority, with downstream effects on funding, hiring, and research direction.
Modelwire context
Analyst takeThe study doesn't just show LLMs cite differently; it demonstrates that this difference systematically deprioritizes critical engagement. Models favor neutral mentions over supportive or contrasting citations, which means LLM-assisted papers may inadvertently flatten the rhetorical work that builds intellectual authority.
This connects directly to the August evaluation work on LLM-as-judge mechanisms (reference [1]) and human judgment alignment (reference [2]). Those papers exposed how LLMs make opaque, systematically biased decisions about quality and value. Citation behavior is the same problem in a different domain: LLMs are now encoding judgments about which ideas matter, which researchers matter, and which knowledge gets amplified. The difference is that citation bias operates at scale across the entire academic publishing pipeline, not just in isolated evaluation tasks. If LLM judges misalign with human reasoning about quality, LLM writers are now misaligning with human reasoning about intellectual contribution.
Monitor whether citation patterns in papers explicitly written with LLM assistance (disclosed in methods sections) show measurably flatter rhetorical texture than human-written controls within the same venues over the next 12-18 months. If the effect persists and grows as LLM adoption increases, watch for downstream shifts in citation counts and h-indices for researchers who adopt LLM writing tools versus those who don't.
Coverage we drew on
This analysis is generated by Modelwire’s editorial layer from our archive and the summary above. It is not a substitute for the original reporting. How we write it.
MentionsLLMs · NLP · arXiv
Modelwire Editorial
This synthesis and analysis was prepared by the Modelwire editorial team. We use advanced language models to read, ground, and connect the day’s most significant AI developments, providing original strategic context that helps practitioners and leaders stay ahead of the frontier.
Modelwire summarizes, we don’t republish. arXiv cs.CL originally reported this story as “Citing Less Critically: LLMs Reshape the Rhetoric and Reach of Scientific Citation”. The full content lives on arxiv.org. If you’re a publisher and want a different summarization policy for your work, see our takedown page.