Fighting fire with fire: AI can detect phony AI-generated chemistry papers
By 
Rebecca Trager2023-11-16T09:30:00
AI detector created can distinguish human-written chemistry papers from ChatGPT-authored ones with 98–100% accuracy
Analytical chemist Heather Desaire and her team at the University of Kansas (KU) have created a detector they say is 98–100% effective at identifying chemistry papers generated by large language models (LLMs) like ChatGPT.1 The researchers argue that their tool can help scientific publishers detect and prevent improper use of artificial intelligence (AI) in academic journals.
The researchers first unveiled their detector in June, when they applied it to Perspectives articles from Science and found that it recognised ChatGPT-generated scientific text with over 99% accuracy.2 But now they have dramatically expanded the tool’s scope by testing it on chemistry papers.