Try our New Bulk Scan Feature - AVAILABLE NOW!
Scan hundreds of URLs or pieces of content for AI, plagiarism and more in just minutes! Available to all users in our app.
Read more Here
AI Studies

Originality.ai Outperforms in Peer-Reviewed Study on AI Text Detection in Academic Writing

In an extension of the peer-reviewed study, “The accuracy-bias trade-offs in AI text detection tools and their impact on fairness in scholarly publication,” Originality.ai demonstrated exceptional results.

Trusted By Industry Leaders
Trusted By Industry Leaders

As the conversation around AI-generated content in scholarly publishing heats up, a new independent peer-reviewed study shines a spotlight on the true capabilities of today’s leading AI text detection tools. 

The study, “The accuracy-bias trade-offs in AI text detection tools and their impact on fairness in scholarly publication,” was published in PeerJ Computer Science, June 2025.

We extended the study by evaluating the same data on Originality.ai’s Turbo and Lite AI detection models, and we are thrilled to share that Originality.ai’s Turbo and Lite models demonstrated exceptional results, outperforming other popular solutions on key benchmarks. 

Here’s what this means for researchers, publishers, and anyone seeking trustworthy AI content detection.

3 Key Findings + Results Overview (TL;DR)

  1. Originality.ai Lite achieved the highest overall accuracy of 98.61% and Originality.ai Turbo also exhibited high performance at 97.69%.
  2. For samples from non-native English-speaking authors, Lite and Turbo each achieved 99.07% accuracy with a 0% False Negative Rate.
  3. Even in the most challenging scenario, with AI-assisted texts, Originality.ai outperformed competitors with a mean score of 97.09%.

Looking for more insight? Check out the quick overview of results below, or keep reading for an in-depth analysis. Try the industry-leading Originality.ai AI Detector today!

Results Overview

Originality.ai Lite achieved the highest overall accuracy of 98.61% and Originality.ai Turbo also exhibited high performance at 97.69%.

  • It outperformed GPTZero (98.15%), ZeroGPT (64.35%), and DetectGPT (54.63%).

Originality.ai Turbo and Lite posted the lowest False Negative Rates (incorrectly identified AI content as human-written):

  • Turbo: 0.00% (did not miss any AI-generated abstract)
  • Lite: 0.69% (missed only 1 out of 144)
  • Others: GPTZero (2.78%), ZeroGPT (45.14%), DetectGPT (52.08%)

For non-native English-speaking authors, both Lite and Turbo had near-perfect detection:

  • Lite: 99.07% accuracy for non-native authors (FNR 0%, FPR 2.78%)
  • Turbo: 99.07% accuracy for non-native authors (FNR 0%, FPR 2.78%)

AI-assisted detection (challenging scenario):

  • Turbo mean score: 97.09%, Lite: 81.6%, while GPTZero was just 37.65%, ZeroGPT 20.92%, DetectGPT 52.36%.

Study Details

This peer-reviewed research systematically evaluated the effectiveness and fairness of multiple AI text detection tools in an academic context.

  • Two key experiments:
    1. Distinguishing between original human-written and fully AI-generated abstracts.
    2. Assessing AI-assisted texts—human-written abstracts enhanced by Large Language Models (LLMs).
  • The focus was on fairness, accuracy, and real-world reliability, especially across author backgrounds and disciplines.

AI Detection Tools Evaluated

The following tools were benchmarked side-by-side:

  • Originality.ai (Turbo)
  • Originality.ai (Lite)
  • GPTZero
  • ZeroGPT
  • DetectGPT

Dataset Information

Evaluation Criteria

The tools were assessed using rigorous and transparent metrics:

  • Accuracy: Correct classifications as human or AI-generated.
  • False Positive Rate (FPR): Human-written flagged as AI.
  • False Negative Rate (FNR): AI-generated missed as human.
  • Summary statistics: Mean, median, quartiles, min/max of detection scores.
  • Scenario-specific metrics:
    • Under-Detection Rate (UDR): AI-assisted texts wrongly marked as 0% AI.
    • Over-Detection Rate (ODR): AI-assisted texts wrongly marked as 100% AI.

Originality.ai’s Performance Highlights

1. Best-in-Class Accuracy

Highlights:

  • Originality.ai Lite: 98.61% accuracy, the highest of all tested tools.
  • Turbo: 97.69% accuracy, top-tier among competitors.

Further, Originality.ai also demonstrated exceptional performance with both Lite and Turbo across disciplines (interdisciplinary, social, and tech & eng samples).

2. Near-Zero Miss Rate (FNR) for AI-Generated Text

Highlights:

  • Turbo: 0% False Negative Rate (FNR)—detected every AI-generated abstract correctly.
  • Lite: 0.69% FNR—missed just one, outpacing all other tools.

3. Superior Results Across Author Types

Highlights:

  • For non-native authors: Lite and Turbo each achieved 99.07% accuracy, supporting fairness and inclusivity, with zero AI misses (FNR 0%) for both.

4. Dominance in the Most Challenging Scenario: AI-Assisted Texts

Highlights:

  • Turbo mean score: 97.09% (out of 100) for AI-assisted (LLM-enhanced) texts, leaving all other tools far behind.
  • Lite mean score: 81.6%, again ahead of GPTZero (37.65%), DetectGPT (52.36%), and ZeroGPT (20.92%).

Final Thoughts

Why choose Originality.ai?

These results confirm that Originality.ai leads the field in accuracy and reliability for AI content detection in academic writing. 

Whether you’re a researcher, educator, or publisher, Originality.ai gives you the confidence to trust what’s on the page. When accuracy and fairness matter most, Originality.ai sets the standard.

Try the most accurate Originality.ai AI Checker today!

Further Reading

Jonathan Gillham

Founder / CEO of Originality.ai I have been involved in the SEO and Content Marketing world for over a decade. My career started with a portfolio of content sites, recently I sold 2 content marketing agencies and I am the Co-Founder of MotionInvest.com, the leading place to buy and sell content websites. Through these experiences I understand what web publishers need when it comes to verifying content is original. I am not For or Against AI content, I think it has a place in everyones content strategy. However, I believe you as the publisher should be the one making the decision on when to use AI content. Our Originality checking tool has been built with serious web publishers in mind!

Frequently Asked Questions

Do I have to fill out the entire form?

No, that’s one of the benefits, only fill out the areas which you think will be relevant to the prompts you require.

Why is the English so poor for some prompts?

When making the tool we had to make each prompt as general as possible to be able to include every kind of input. Not to worry though ChatGPT is smart and will still understand the prompt.

In The Press

Originality.ai has been featured for its accurate ability to detect GPT-3, Chat GPT and GPT-4 generated content. See some of the coverage below…

View All Press
Featured by Leading Publications

Originality.ai did a fantastic job on all three prompts, precisely detecting them as AI-written. Additionally, after I checked with actual human-written textual content, it did determine it as 100% human-generated, which is important.

Vahan Petrosyan

searchenginejournal.com

I use this tool most frequently to check for AI content personally. My most frequent use-case is checking content submitted by freelance writers we work with for AI and plagiarism.

Tom Demers

searchengineland.com

After extensive research and testing, we determined Originality.ai to be the most accurate technology.

Rock Content Team

rockcontent.com

Jon Gillham, Founder of Originality.ai came up with a tool to detect whether the content is written by humans or AI tools. It’s built on such technology that can specifically detect content by ChatGPT-3 — by giving you a spam score of 0-100, with an accuracy of 94%.

Felix Rose-Collins

ranktracker.com

ChatGPT lacks empathy and originality. It’s also recognized as AI-generated content most of the time by plagiarism and AI detectors like Originality.ai

Ashley Stahl

forbes.com

Originality.ai Do give them a shot! 

Sri Krishna

venturebeat.com

For web publishers, Originality.ai will enable you to scan your content seamlessly, see who has checked it previously, and detect if an AI-powered tool was implored.

Industry Trends

analyticsinsight.net

Frequently Asked Questions

Why is it important to check for plagiarism?

Tools for conducting a plagiarism check between two documents online are important as it helps to ensure the originality and authenticity of written work. Plagiarism undermines the value of professional and educational institutions, as well as the integrity of the authors who write articles. By checking for plagiarism, you can ensure the work that you produce is original or properly attributed to the original author. This helps prevent the distribution of copied and misrepresented information.

What is Text Comparison?

Text comparison is the process of taking two or more pieces of text and comparing them to see if there are any similarities, differences and/or plagiarism. The objective of a text comparison is to see if one of the texts has been copied or paraphrased from another text. This text compare tool for plagiarism check between two documents has been built to help you streamline that process by finding the discrepancies with ease.

How do Text Comparison Tools Work?

Text comparison tools work by analyzing and comparing the contents of two or more text documents to find similarities and differences between them. This is typically done by breaking the texts down into smaller units such as sentences or phrases, and then calculating a similarity score based on the number of identical or nearly identical units. The comparison may be based on the exact wording of the text, or it may take into account synonyms and other variations in language. The results of the comparison are usually presented in the form of a report or visual representation, highlighting the similarities and differences between the texts.

String comparison is a fundamental operation in text comparison tools that involves comparing two sequences of characters to determine if they are identical or not. This comparison can be done at the character level or at a higher level, such as the word or sentence level.

The most basic form of string comparison is the equality test, where the two strings are compared character by character and a Boolean result indicating whether they are equal or not is returned. More sophisticated string comparison algorithms use heuristics and statistical models to determine the similarity between two strings, even if they are not exactly the same. These algorithms often use techniques such as edit distance, which measures the minimum number of operations (such as insertions, deletions, and substitutions) required to transform one string into another.

Another common technique for string comparison is n-gram analysis, where the strings are divided into overlapping sequences of characters (n-grams) and the frequency of each n-gram is compared between the two strings. This allows for a more nuanced comparison that takes into account partial similarities, rather than just exact matches.

String comparison is a crucial component of text comparison tools, as it forms the basis for determining the similarities and differences between texts. The results of the string comparison can then be used to generate a report or visual representation of the similarities and differences between the texts.

What is Syntax Highlighting?

Syntax highlighting is a feature of text editors and integrated development environments (IDEs) that helps to visually distinguish different elements of a code or markup language. It does this by coloring different elements of the code, such as keywords, variables, functions, and operators, based on a predefined set of rules.

The purpose of syntax highlighting is to make the code easier to read and understand, by drawing attention to the different elements and their structure. For example, keywords may be colored in a different hue to emphasize their importance, while comments or strings may be colored differently to distinguish them from the code itself. This helps to make the code more readable, reducing the cognitive load of the reader and making it easier to identify potential syntax errors.

How Can I Conduct a Plagiarism Check between Two Documents Online?

With our tool it’s easy, just enter or upload some text, click on the button “Compare text” and the tool will automatically display the diff between the two texts.

What Are the Benefits of Using a Text Compare Tool?

Using text comparison tools is much easier, more efficient, and more reliable than proofreading a piece of text by hand. Eliminate the risk of human error by using a tool to detect and display the text difference within seconds.

What Files Can You Inspect with This Text Compare Tool?

We have support for the file extensions .pdf, .docx, .odt, .doc and .txt. You can also enter your text or copy and paste text to compare.

Will My Data Be Shared?

There is never any data saved by the tool, when you hit “Upload” we are just scanning the text and pasting it into our text area so with our text compare tool, no data ever enters our servers.

Software License Agreement

Copyright © 2023, Originality.ai

All rights reserved.

Redistribution and use in source and binary forms, with or without modification, are permitted provided that the following conditions are met:

  1. Redistributions of source code must retain the above copyright notice, this list of conditions and the following disclaimer.

  1. Redistributions in binary form must reproduce the above copyright notice, this list of conditions and the following disclaimer in the documentation and/or other materials provided with the distribution.

THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS “AS IS” AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.

Will My Data Be Shared?

This table below shows a heat map of features on other sites compared to ours as you can see we almost have greens across the board!

More From The Blog

Al Content Detector & Plagiarism Checker for Marketers and Writers

Use our leading tools to ensure you can hit publish with integrity!