Detection tool accuracy rankings, comprehensive test
Has anyone else noticed the changes to ChatGPT recently? I’ve been tracking the accuracy and here’s what I found.
I’ve been lurking on this forum for months and finally decided to contribute because I see a lot of misinformation floating around. No shade to anyone but I think we owe it to each other to be accurate about this stuff.
I know a lot of people have strong opinions on this but I think the data speaks for itself. I tried to be as objective as possible and test everything under the same conditions. Your mileage may vary of course but these numbers are hard to argue with.
What do you all think? Am I off base here or does this match your experience too?
6 Replies
Join the discussion.
Log In to Reply
Solid analysis. I've been testing Copyleaks myself and got similar numbers. The consistency is getting better but still not where it needs to be.
Can confirm this matches what I've seen. My roommate got flagged for a paper she definitely wrote herself and it was a nightmare to appeal.
Really appreciate the objectivity here. Too many reviews are either sponsored or have an agenda.
This confirms what I suspected but hadn't been able to prove. Thanks for doing the legwork.
This is really helpful, thanks for putting this together! I had a similar experience with Turnitin last semester.
Totally agree with you on that. I had a professor last semester who didn't even know how to interpret Turnitin reports properly.