HarDBench: A Benchmark for Draft-Based Co-Authoring Jailbreak Attacks for Safe Human-LLM Collaborative Writing
Source published ·Modelwire updated
Original coverage: arXiv cs.CL ↗·How Modelwire adds context
The development
Researchers introduce HarDBench, a benchmark exposing how LLMs can be jailbroken through draft-based co-authoring attacks where malicious users seed incomplete documents with harmful content to force unsafe completions. The work systematically evaluates model robustness across high-risk domains including explosives, drugs, weapons, and cyberattacks.
Modelwire’s AI-generated summary of coverage from arXiv cs.CL.
Modelwire analysis
ExplainerOur AI-generated reading of the wider context and the next developments to watch.
The key distinction HarDBench draws is that co-authoring attacks exploit the model's role as a completer rather than a responder: the harmful payload is seeded in the user's draft, not in an explicit instruction, which means standard prompt-level safety filters may not catch it at all.
Modelwire has been tracking a wave of domain-specific benchmarks this month, including IndiaFinBench and QuantCode-Bench, but those measure capability. HarDBench sits in a different category: it measures where safety breaks down under realistic usage conditions. The WIRED piece from April 17 on AI-assisted drafting in newsrooms is the more relevant adjacent story here, because it describes exactly the workflow HarDBench stress-tests: a human seeds a document and an LLM completes it. That piece framed the concern as editorial quality and labor; this paper surfaces a harder problem, which is that the same workflow can be weaponized. Together they suggest that co-authoring tools are being deployed before the safety research has caught up.
Watch whether major co-authoring tool vendors (Microsoft Copilot, Google Docs AI, Notion AI) acknowledge HarDBench or publish any red-teaming results against draft-completion attack vectors within the next six months. Silence from that group would confirm the gap the paper implies.
This interpretation is generated from the summary above and the archive coverage cited below. Our methodology · Report an error
Coverage behind this analysis
These archive entries ground the connection in our analysis. They are ordered by source publication date, with links to our coverage and the original sources.
·WIRED — AI
AI Drafting My Stories? Over My Dead Body
WIRED examines how newsrooms are adopting AI-assisted writing tools to boost productivity, while questioning whether efficiency gains justify potential editorial and labor costs that publishers have yet to fully reckon with.
MentionsHarDBench · LLMs
How this coverage is produced
Modelwire uses AI to generate summaries and context from source headlines, snippets, and selected archive coverage. Automated checks do not verify every claim, and items are not routinely reviewed by a person before publication. Zacaria Solis operates the site. Read the linked source for the full evidence and report errors through our corrections process.
Modelwire summarizes, we don’t republish. The full content lives on arxiv.org. If you’re a publisher and want a different summarization policy for your work, see our takedown page.