MIT报告建议教育界不要依赖AI检测器，指出其概念上存在根本缺陷：学生真实作业中缺乏独立ground truth来验证检测标记是否正确。即使零误报的检测器也会漏掉擅长伪装AI输出的学生，最终惩罚的不是AI使用而是掩饰技巧。报告还警告检测可能误伤非英语母语者或神经多样性学生，并引发“AI人形化”军备竞赛。
If you need more proof that AI detectors fails in education, this paper makes the case so simple and clear.
These "AI detectors" tools are conceptually unsound because, in real student work, there is no independent ground truth to verify whether a flag was actually correct.
Even a detector with a perfect record on false positives would still fail, because the students it misses are the ones skilled enough to disguise their output. What ends up being punished is not AI use but clumsiness at hiding it.
A detector's accuracy rate tells you nothing about whether any particular flag it raises is correct.
Turning that rate into a probability about any one flagged case needs the base rate, which is unknowable.
So a classifier deployed where ground truth is never observable cannot settle an individual case, only justify a closer look.
Detectors measure something real on labelled corpora, but this paper argues the measurement cannot travel into settings where nothing confirms authorship.
Even a detector with no false positives does not fix this: in the paper's hypothetical, such a tool cleared 27 papers of which 11 were entirely AI-generated.
The AI detector industry should be very uncomfortable reading this MIT report. The strongest institutional rejections yet, direct from MIT. "we recommend against relying on AI detectors. " "As it risks an arms race in which students respond to automated detection by using increasingly powerful “AI humanizers” to remove signals that AI detectors are cued to catch. The result: a lot of effort on both sides that in the end serves no one." The report argues that mixed human/AI writing is difficult to detect, detectors can be evaded by “AI humanizers,” false positives can harm students, and heavy policing creates distrust. AI detection systems may also mistake the writing of non-native English speakers or neurodivergent students for text generated by AI. Even low rates of false positives can put students on edge and cause serious individual consequences."在 X 查看被引用的帖子
来源：Rohan Paul · x.com