Running a Side-by-Side Accuracy Benchmark of Code Plagiarism Checkers
We ran 2,400 real student Java assignments through MOSS, JPlag, Turnitin, and Codequiry with known ground truth. The F1 scores and false positive rates diverged by over 20 percentage points. Here’s what worked, what broke, and how to run your own benchmark.