AI can beat university students, study suggests

A recent study conducted by the University of Reading has revealed that artificial intelligence (AI) can outperform university students in exams. The researchers created 33 fictitious students and employed the AI tool ChatGPT to generate answers for module exams in an undergraduate psychology degree program. The results showed that the AI-generated answers were, on average, half a grade boundary higher than those of real students. Additionally, the AI-generated essays were nearly undetectable, with 94% of them not raising any concerns among the markers. The study, which was published in the journal Plos One, highlights a significant issue: students could potentially use AI to cheat and achieve better grades than their peers who do not cheat.

Associate Prof Peter Scarfe and Prof Etienne Roesch, who led the study, emphasized that their findings should serve as a wake-up call for educators worldwide. Dr. Scarfe pointed out that many educational institutions have moved away from traditional exams to make assessments more inclusive. However, he stressed the importance of understanding how AI will impact the integrity of educational assessments. He noted that while a complete return to handwritten exams is unlikely, the global education sector will need to adapt in response to the rise of AI.

In the study, the researchers submitted fake exam answers and essays for first-, second-, and third-year modules without informing the markers. The AI-generated answers outperformed those of real students in the first two years of the program. However, in the third-year exams, real students scored better, which the researchers attributed to the current limitations of AI in handling more abstract reasoning. This study is the largest and most robust blind study of its kind to date. The influence of AI in education has been a growing concern among academics. Earlier this year, another study found that most undergraduates used AI programs to assist with their essays, but only 5% admitted to submitting unedited AI-generated text.

The University of Reading's study underscores the need for educators to be vigilant about the potential misuse of AI in academic settings. As AI technology continues to advance, it is crucial for educational institutions to develop strategies to maintain the integrity of assessments. This may involve a combination of traditional and modern assessment methods to ensure that students are evaluated fairly and accurately. The findings of this study serve as a reminder that while AI can be a valuable tool, it also poses challenges that must be addressed to preserve the quality and fairness of education.