AI in science: Arxiv tightens rules for AI-generated research

For many people, AI tools have long been a given in everyday academic life. However, uniform guidelines for dealing with the new technology are often still lacking. Some examination offices are even using AI themselves to detect plagiarism, while its use in academic papers is increasingly being regulated. Now the Arxiv research archive has also decided to deal more strictly with AI-generated works.

Online Archive introduces new AI guidelines

Arxiv is a widely used, open archive for scientific advance publications. As Techcrunch reports, the platform was hosted by Cornell University for more than 20 years and has become an important channel for research exchange in areas such as computer science and mathematics. It is currently transforming itself into an independent, non-profit organization – and has therefore decided to take stricter action against the uncritical use of large language models (LLM).

Arxiv has already taken initial measures to counteract the growing number of low-quality, AI-generated articles. First authors now have to provide a recommendation from established authors. Thomas Dietterich, chairman of Arxiv’s computer science department, also wrote in a recent post on He cited hallucinated citations as an example of such evidence.

Responsibility lies with the authors

The new rules are not a general ban on AI. Rather, it’s about authors having to take full responsibility for their works – regardless of how the content was generated. Anyone who adopts inappropriate language, plagiarized content, incorrect sources or misleading information directly from an AI model is liable. If there is corresponding evidence, there is a risk of a one-year Arxiv ban, followed by the requirement that subsequent submissions first be accepted by a recognized peer review platform.

Dietterich explained to 404 Media that the rule takes effect after the first violation. However, moderators would first have to report the problem and department chairs would have to confirm the evidence before a penalty was imposed. Objections are also possible. Recent research shows that fabricated citations in biomedical literature are increasing, likely due to the use of AI. AI is also widespread at universities in Germany. According to a nationwide survey by Darmstadt University of Applied Sciences, by 2025 92 percent of students would be using tools like ChatGPT at least occasionally.

AI tools can make serious mistakes

According to the study, more than two thirds of students use AI to clarify comprehension questions. Around 52 percent also use them for text analysis and creation. However, reliably recognizing AI-generated passages is still difficult. Universities have been using plagiarism checking tools for years: Turnitin, which was expanded to include an AI detector in 2023, is one of them. As the ABC reported last year, numerous students at the Australian Catholic University (ACU) were falsely accused of cheating through this tool, with serious professional consequences for some of them.

A nursing student reported receiving an email shortly before graduating accusing her of using AI in a term paper. It took six months for her to be exonerated. During this time, her certificate contained a note, which, according to the student, meant that she was unable to find a job as a young professional. According to ABC, the university apparently relied too often exclusively on automated assessments, even though the developers expressly recommend manual review.