Australian universities have been forced to change the way they run exams and other assessments amid fears students are using emerging artificial intelligence software to write essays.

Major institutions have added new rules which state that the use of AI is cheating, with some students already caught using the software. But one AI expert has warned universities are in an “arms race” they can never win.

ChatGPT, which generates text on any subject in response to a prompt or query, was launched in November by OpenAI and has already been banned across all devices in New York’s public schools due to concerns over its “negative impact on student learning” and potential for plagiarism.

In London, one academic tested it against a 2022 exam question and said the AI’s answer was “coherent, comprehensive and sticks to the points, something students often fail to do”, adding he would have to “set a different kind of exam” or deprive students of internet access for future exams.

In Australia, academics have cited concerns over ChatGPT and similar technology’s ability to evade anti-plagiarism software while providing quick and credible academic writing.

The Group of Eight leading universities – the leading research-intensive universities around the country – said they had revised how they would run assessments this year due to the emergent technology.

The group’s deputy chief executive, Dr Matthew Brown, said its institutions were “proactively tackling” AI through student education, staff training, redesigning assessments and targeted technological and other detection strategies.

“Our universities have revised how they will run assessments in 2023, including supervised exams … greater use of pen and paper exams and tests … and tests only for units with low integrity risks.

“Assessment redesign is critical, and this work is ongoing for our universities as we seek to get ahead of AI developments.”

The University of Sydney’s latest academic integrity policy now specifically mentions “generating content using artificial intelligence” as a form of cheating.

A spokesperson said while few instances of cheating had been observed, and cases were generally of a low standard, the university was preparing for change by redesigning assessments and improving detection strategies.

“We also know AI can help students learn, and