arXiv imposes one-year submission ban for unchecked AI-generated content

TL;DR:

  • arXiv has clarified that authors submitting work containing “incontrovertible evidence” of unchecked large language model output face a one-year submission ban.
  • After the ban, subsequent arXiv submissions must first be accepted at a reputable peer-reviewed venue.
  • Examples of evidence include hallucinated references and accidentally pasted AI meta-comments such as “here is a 200 word summary; would you like me to make any changes?”

The world’s largest preprint server has put concrete teeth into its AI-author policy. Thomas Dietterich, current chair of the Computer Science Section of arXiv, set out in a series of X posts this week that authors who submit papers with clear evidence of unchecked LLM output face a one-year submission ban — followed by a requirement that subsequent submissions be accepted at a reputable peer-reviewed venue before arXiv will accept them again.

The policy and its evidence threshold

The Code of Conduct framing is unambiguous: “by signing your name as an author of a paper, each author takes full responsibility for all its contents, irrespective of how the contents were generated.” Where AI tools produce “inappropriate language, plagiarised content, biased content, errors, mistakes, incorrect references, or misleading content,” responsibility still sits entirely with the authors.

The enforcement threshold is “incontrovertible evidence” that authors did not check LLM-generated output. Dietterich cited two telling examples: hallucinated references (LLMs inventing plausible-looking but non-existent citations) and accidental inclusion of AI meta-comments such as “here is a 200 word summary; would you like me to make any changes?” or “the data in this table is illustrative, fill it in with the real numbers from your experiments.” Those second-category examples are particularly damning because they prove not just that AI was used, but that the human author never read what they were submitting.

A pattern across professional publishing

The arXiv move sits in a clear pattern. The same week, the Financial Times reported that EY Canada had retracted a published study on loyalty rewards programmes after researchers at GPTZero found hallucinated McKinsey citations, fabricated data and footnotes pointing to non-existent web pages. Deloitte had to revise a report for a Canadian provincial government last year for the same reasons; law firm Sullivan & Cromwell apologised to a New York court last month after a filing misquoted the US bankruptcy code and cited cases incorrectly.

For UK universities, research institutes and corporate research teams, the arXiv signal is operationally important. arXiv hosts the largest body of physics, mathematics, computer science and quantitative biology preprints in the world; a one-year ban is a serious career-cost for an active researcher. The institutional implication is that AI-use policies need to move beyond “permitted/prohibited” into specific verification workflows — author sign-off on every citation, mandatory secondary review of AI-drafted prose, and automated detection of common AI meta-comment patterns before submission.

Looking forward

arXiv has not banned AI tools from manuscript preparation. The policy is squarely about author accountability — the same framing the financial regulators applied to AI cyber risk this week, and the framing UK government departments are applying as they sign £100,000 and £175 million AI procurement deals. Across publishing, financial regulation and procurement, the operative principle is converging: human accountability does not transfer to the tool. The next test is whether peer-reviewed publishers follow arXiv with comparably explicit penalties, and whether the verification workflows required actually scale to the volume of AI-assisted writing now flowing through the academic publishing system.