{"id":285,"date":"2026-10-01T19:59:42","date_gmt":"2026-10-01T19:59:42","guid":{"rendered":"https:\/\/prowad.pro\/do-ai-detectors-actually-work\/"},"modified":"2026-10-01T19:59:42","modified_gmt":"2026-10-01T19:59:42","slug":"do-ai-detectors-actually-work","status":"publish","type":"post","link":"https:\/\/prowad.pro\/fr\/do-ai-detectors-actually-work\/","title":{"rendered":"Do AI Detectors Actually Work? What the Evidence Shows"},"content":{"rendered":"

GPTZero advertises 99% accuracy on its homepage. Independent peer-reviewed testing of 14 detection tools, including GPTZero and Turnitin, found that all scored below 80% accuracy, and only five exceeded 70%. Both of those facts are real and current. The gap between them is the actual story, and it matters directly to anyone relying on a detector to decide whether a student used AI.<\/p>\n\n\n\n

What independent testing actually found<\/h2>\n\n\n\n

The most cited independent evaluation, Weber-Wulff et al. (2023), published in the peer-reviewed International Journal for Educational Integrity<\/em>, tested 14 detection tools and found all scored below 80% accuracy, with only five exceeding 70%. The study identified a consistent bias: detectors tend to classify ambiguous text as human-written rather than AI-written, and accuracy drops further once text has been paraphrased, which is exactly what a ‘humanizer’ tool or a quick manual edit does.<\/p>\n\n\n\n

The false-positive problem lands unevenly. A separate peer-reviewed study in Patterns<\/em> (Liang et al., 2023) found detectors misclassified 61% of essays written by non-native English speakers as AI-generated, a finding we covered in detail in our piece on the Brown University cheating case<\/a>. A separate Common Sense Media survey found generative-AI detectors produced a 20% false positive rate for Black students, compared with 10% for Latino students and 7% for White students. These are not scattered anecdotes; they are a consistent pattern across independent studies with different authors, methods, and years.<\/p>\n\n\n\n

Why vendor claims and independent findings diverge<\/h2>\n\n\n\n

A 2026 academic analysis examining this exact gap found that vendors’ headline accuracy figures, GPTZero’s claimed 99.39% on its own multi-domain evaluation, Pangram’s claimed 99.98%, come from vendor marketing materials and vendor-run benchmarks, not from independent replication. That is not necessarily evidence of dishonesty; a vendor’s internal benchmark and an independent researcher’s real-world sample of student writing are measuring different things. But it means a detector’s own claimed accuracy is not a substitute for independent evidence, and the two numbers should not be read as describing the same reality.<\/p>\n\n\n\n

What the vendors themselves say, which is easy to miss<\/h2>\n\n\n\n

This is worth stating plainly because it rarely makes it into how these tools are actually used: both major vendors explicitly disclaim the use case schools most often put them to. Turnitin’s own FAQ states its percentage score ‘should not be used as the sole basis for action’ against a student. GPTZero’s own FAQ states ‘no AI detector is 100% accurate’ and that results ‘should not be used to punish or as the final verdict.’ A score from either tool, used by the vendor’s own stated terms, is a prompt for a conversation, not a verdict.<\/p>\n\n\n\n

What this means in practice<\/h2>\n\n\n\n