![]() “You can’t go around accusing people of surreptitiously using AI and be frequently wrong in those accusations - accuracy is critical. “When you start to think about ‘AI plagiarism,’ 90% accurate isn’t good enough,” Desaire said. They are useful for their intended purpose, but on any specific kind of writing, they’re not going to be as accurate as a tool built for that specific and narrow purpose.”ĭesaire said university instructors, grant-giving entities and publishers all require a precise way to detect AI output presented as work from a human mind. “Existing AI detectors are typically designed as general tools to be leveraged on any kind of writing. “You can easily build a method to distinguish human from ChatGPT writing that is highly accurate, given the trade-off that you’re restricting yourself to considering a particular group of humans who write in a particular way,” Desaire said. This improves accuracy over existing AI-detection tools, like the RoBERTa detector, which aim to detect AI in more general writing. She said the success of her detection method depends on narrowing the scope of writing under scrutiny to scientific writing of the kind found commonly in peer-reviewed journals. Once you start populating real scientific facts with made-up AI nonsense that sounds perfectly believable, those publications are going to become less trustable, less valuable.” As far as I’m aware, there’s no foolproof way to, in an automated fashion, find those ‘hallucinations’ as they’re called. They’d unavoidably make their way into publications if AI text generators are commonly used. “In academic science publishing - writings about new discoveries and the edge of human knowledge - we really can’t afford to pollute the literature with believable-sounding falsehoods. “ChatGPT and all other AI text generators like it make up facts,” she said. Wilner Chair in Chemistry at KU, said accurate AI-detection tools urgently are required to defend scientific integrity. The peer-reviewed journal Cell Reports Physical Science published research showing the efficacy of her AI-detection method, along with sufficient source code for others to replicate the tool.ĭesaire, the Keith D. ![]() LAWRENCE - Heather Desaire, a chemist who uses machine learning in biomedical research at the University of Kansas, has unveiled a new tool that detects with 99% accuracy scientific text generated by ChatGPT, the artificial intelligence text generator. ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |