CWE AI Detector Statement
CWE Generative AI Detector Statement
August 2024
While AI detector software might seem useful as a way to check for or prevent unpermitted students鈥 AI-use, they are problematic, in many of the same ways plagiarism detector software is problematic, especially in an educational setting.
Why are AI Detectors problematic?
- Detection software is inherently flawed and can be easily fooled. There are many websites that claim they can 鈥渉umanize AI writing鈥 so they can鈥檛 be detected.
- Even detection systems that claim to have been tested for accuracy can be flawed and evaded through other software designed to mediate the detection of AI language and phrasing.
- Using detectors may violate students鈥 rights and sense of autonomy in classrooms.
- AI detectors have accuracy issues:
- They generate false positives and false negatives: they have high-error rates in detecting AI-generated text or identifying non-AI text
- They give an illusion of accuracy: you cannot rely on lists of phrases or words to identify text generated by AI
- It鈥檚 unclear how they are built: we don鈥檛 know the mathematical formulas that AI detectors use, so they shouldn鈥檛 be considered reliable
- AI detectors can create social harm and bias:
- False accusations: the potential for unfair punishments due to erroneous detections; there have been several high profile cases where students were wrongly accused of using AI.
- Demographic bias: text from non-native speakers of English and minority groups can be disproportionately flagged as AI generated.
If AI Detectors are flawed, what is the alternative?
Assessment practices that rely solely on evaluation of a discrete finished product are particularly vulnerable to abuses of generative AI; therefore, working with students through the various stages of the writing process, and scaffolding longer projects, may reduce the perceived need to use detectors. In other words, the same strategies for discouraging plagiarism also work when we want to discourage the misuse of AI: design engaging classrooms, activities, and assignments; make it clear why you are asking students to do things, what they will learn from them, and how they will benefit; use best practices in writing assignment design, including building in attention to the writing process; and scaffold longer assignments into smaller chunks that are discussed and used in class. Asking students to do peer-response and revise their writing, meet with their instructors to discuss their writing, give oral presentations on their topic, and engage in written reflection about their writing are also not only best practices in writing instruction which help students learn content and become more effective writers, they also help discourage the misuse of AI.
Works Cited
Akben, Mustafa. 鈥漅ecent Advancements, AI Tools, and AI Detectors.鈥 August 2, 2024. AI Assessment Workshop.
MLA-CCCC Joint Task Force on Writing and AI, 鈥淕enerative AI and Policy Development: Guidance from the MLA-CCCC Task Force,鈥 April 2024,
Steere, Elizabeth, 鈥淭he Trouble With AI Writing Detection,鈥 Inside Higher Ed, October 18, 2023,
Teo, Kai Xiang, 鈥淓ven OpenAI’s Own Detection Service Can’t Tell AI-Generated Work Apart 鈥 The Company Quietly Took It Down Over Accuracy Concerns,鈥 Yahoo! Tech, July 26, 2023. https://www.yahoo.com/tech/even-openais-own-detection-cant-093459778.html
Thompson, Stuart A., and Tiffany Hsu. 鈥淗ow Easy Is It to Fool A.I.-Detection Tools?鈥 The New York Times, 28 June 2023,