The Most Accurate AI Content Detector
Try Our AI Detector
AI Writing

Grammarly AI Content Detector Review: Easy to Bypass

Does Grammarly's AI Detector effectively detect AI-generated content? We reviewed the Grammarly AI Detector using the RAID dataset and three samples of ChatGPT content to find out — these are our results!

Trusted By Industry Leaders
Trusted By Industry Leaders

Introduction

Our text compare tool is a fantastic, lightweight tool that provides plagiarism checks between two documents. Whether you are a student, blogger or publisher, this tool offers a great solution to detect and compare similarities between any two pieces of text. In this article, I will discuss the different ways to use the tool, the primary features of the tool and who this tool is for. There is an FAQ at the bottom if you run into any issues when trying to use the tool.

What makes Originality.ai’s text comparison tool stand out?

Keyword density helper – This tool comes with a built-in keyword density helper in some ways similar to the likes of SurferSEO or MarketMuse the difference being, ours is free! This feature shows the user the frequency of single or two word keywords in a document, meaning you can easily compare an article you have written against a competitor to see the major differences in keyword densities. This is especially useful for SEO’s who are looking to optimize their blog content for search engines and improve the blog’s visibility.

Ways to compare

File compare – Text comparison between files is a breeze with our tool. Simply select the files you would like to compare, hit “Upload” and our tool will automatically insert the content into the text area, then simply hit “Compare” and let our tool show you where the differences in the text are. By uploading a file, you can still check the keyword density in your content.

URL compare

Comparing text between URLs is effortless with our tool. Simply paste the URL you would like to get the content from (in our example we use a fantastic blog post by Sherice Jacob found here) hit “Submit URL” and our tool will automatically retrieve the contents of the page and paste it into the text area, then simply click “Compare” and let our tool highlight the difference between the URLs. This feature is especially useful for checking keyword density between pages!

Simple text compare

You can also easily compare text by copying and pasting it into each field, as demonstrated below.

Features of Originality.ai’s Text Compare Tool

Ease of use

Our text compare tool is created with the user in mind, it is designed to be accessible to everyone. Our tool allows users to upload files or enter a URL to extract text, this along with the lightweight design ensures a seamless experience. The interface is simple and straightforward, making it easy for users to compare text and detect the diff.

Multiple text file format support

Our tool provides support for a variety of different text files and microsoft word formats including pdf file, .docx, .odt, .doc, and .txt, giving users the ability to compare text from different sources with ease. This makes it a great solution for students, bloggers, and publishers who are looking for file comparison in different formats.

Protects intellectual property

Our text comparison tool helps you protect your intellectual property and helps prevent plagiarism. This tool provides an accurate comparison of texts, making it easy to ensure that your work is original and not copied from other sources. Our tool is a valuable resource for anyone looking to maintain the originality of their content.

User Data Privacy

Our text compare tool is secure and protects user data privacy. No data is ever saved to the tool, the users’ text is only scanned and pasted into the tool’s text area. This makes certain that users can use our tool with confidence, knowing their data is safe and secure.

Compatibility

Our text comparison tool is designed to work seamlessly across all size devices, ensuring maximum compatibility no matter your screen size. Whether you are using a large desktop monitor, a small laptop, a tablet or a smartphone, this tool adjusts to your screen size. This means that users can compare texts and detect the diff anywhere without the need for specialized hardware or software. This level of accessibility makes it an ideal solution for students or bloggers who value the originality of their work and need to compare text online anywhere at any time.

As AI content generation continues to advance, more brands are adding AI-based features and AI tools to their offerings.

One brand that’s recently gone down this avenue is Grammarly. In August 2024, Grammarly released an announcement that it’s adding an AI content detector to its suite of tools. This news comes despite Grammarly’s previous stance that AI detection tools are ‘unreliable.’ 

In this review, we’ll test the Grammarly AI Content Detector to see if it’s reliable.

In This Article

  • Find out what Grammarly is
  • Discover why there’s interest in tools like Grammarly's AI detector
  • Review our AI content detection tests with Grammarly and the Originality AI Detector
  • Get a final verdict on whether Grammarly is a reliable tool

What Is Grammarly?

Grammarly initially launched into the mainstream as a grammar-checking tool, offering users a free plugin that helped them ensure their grammar was correct, their word usage was as effective as possible, and the structure of their content matched their intent.

Since then, the tool has become a go-to option for marketers, small business owners, and writers.

Despite their apparent distrust of AI content detectors as ‘unreliable’ (see the above screenshot), Grammarly has decided to create their own tool. Hopefully, this is a sign that the company is coming to an understanding of the importance of AI detection.

Why are people interested in Grammarly's AI Detector?

There is no doubt that AI content generation has its benefits. It can be an incredible tool for creating content briefs or helping with content ideation.

However, AI text also creates problems, including plagiarism, a lack of transparency, and problems with potentially getting marked as spam by Google.

With that in mind, industry leaders, business owners, and marketing experts are looking for a reliable AI detector to gain clarity for content production and content consumption.

Grammarly AI Detector Review With RAID Dataset

In our evaluation of the Grammarly AI Detector using the RAID AI detection accuracy study dataset, it is clear that the detector is highly susceptible to bypassing techniques, especially when tested with adversarial attacks.

The RAID dataset, designed to test the robustness of AI content detectors, showed critical weakness in Grammarly’s AI detection capabilities.

Grammarly’s Performance

  • Poor Performance: Grammarly's AI detector scored an F1 of 0.364 and a low recall of 0.222, missing most AI-generated content.
  • Easily Bypassed: Simple text alterations, such as paraphrasing, alternative spellings, and formatting changes, can evade Grammarly's detection.
  • Limited Scope: Struggles with AI-generated content from models beyond GPTs or Llama, showing a narrow detection capability.
  • Accuracy: 22.22%

Originality.ai’s Performance

  • Strong Performance: Originality.ai scored an F1 of 0.918 and a high recall of 0.848, effectively detecting most AI-generated content.
  • Highly Accurate: With a perfect precision of 1.0, Originality.ai’s AI checker accurately detected AI-generated content with an Accuracy of 84.84%
  • Wide Detection Capability: Performed consistently across different adversarial attacks and AI models, showing strong robustness against a wide range of AI-generated text.

Dataset used for evaluation

The RAID dataset (Robust AI Detection) is a benchmark specifically designed to evaluate the robustness of AI-generated text detectors.

It includes a wide variety of adversarial attacks and multiple AI models making it an effective tool to test a detector's ability to identify manipulated AI-generated content. The dataset's diversity in text manipulations and generative models helps expose weaknesses in AI detection tools, highlighting their susceptibility to adversarial techniques.

  • Adversarial Attacks: alternative_spelling, article_deletion, insert_paragraphs, number, paraphrase, perplexity_misspelling, synonym, upper_lower, whitespace
  • Models: chatgpt, cohere, cohere-chat, gpt2, gpt3, gpt4, llama-chat, mistral, mistral-chat, mpt, mpt-chat
  • Total number of samples selected: 99 (11 from each kind of adversarial attack x model)

The verdict: Grammarly is easy to bypass with the RAID dataset

In conclusion, Grammarly’s AI detection might be able to catch obvious instances of AI-generated text. However, it’s easy to bypass with minimal effort. On the other hand, Originality.ai’s AI detector demonstrated a strong, robust performance as a more reliable AI content detection tool.

How We Tested Grammarly’s AI Detector With 3 ChatGPT Content Samples

As part of this review, we tested Grammarly’s AI detector with three different forms of AI content.

Step 1: We started by building out detailed prompts for each test before posting them into ChatGPT, one of the most frequently used AI content generators.

Step 2: From there, we took the exact copy output from ChatGPT for each test and pasted the results into Grammarly’s AI content detector (without making any changes) to help show whether or not the tool can detect AI-generated content.

Step 3: For comparison, we also took that exact same copy and pasted it into the Originality.ai AI content detector, allowing us to see how each tool compares with the same content input.

The three types of content used in this test include:

  • Blog posts
  • Research papers
  • Promotional emails

AI Content Sample 1: Blog Post

Prompt: "Write a concise blog post on the benefits of investing in a summerhouse as a garden office, targeting professionals and business owners.

Key points:

  1. Introduction: Introduce the idea of a summerhouse garden office and its rising popularity.
  2. Productivity and Work-Life Balance: Explain how a dedicated garden office improves focus and helps maintain work-life boundaries.
  3. Customization and Comfort: Highlight the ability to personalize the space for comfort and productivity.
  4. Property Value and Aesthetic Appeal: Discuss the potential to increase property value and enhance garden aesthetics.
  5. Cost-Effectiveness: Compare setup costs to traditional office expenses, noting long-term savings.
  6. Environmental and Health Benefits: Mention reduced commuting and health perks from being closer to nature.
  7. Conclusion: Summarize the benefits and encourage consideration of a summerhouse office.

Keep the tone professional, clear, and persuasive."

Originality.ai

Originality.ai AI Detector: 99% AI & 1% Human-written

Grammarly AI

Grammarly AI Score: 99% AI & 1% Human-written

AI Content Sample 2: Research Paper

Prompt: "Write a research paper exploring the benefits of using a summerhouse as a garden office, targeting a scholarly audience.

Focus Areas:

  1. Introduction: Outline the concept and relevance of a garden office in the remote work era.
  2. Productivity and Work-Life Balance: Analyze the impact on productivity and maintaining work-life boundaries.
  3. Customization and Comfort: Investigate how summerhouses can be tailored for ergonomic and comfortable workspaces.
  4. Property Value and Aesthetics: Assess the effect on property value and garden design.
  5. Economic and Environmental Benefits: Compare costs with traditional offices and explore environmental impacts.
  6. Legal Considerations: Briefly examine relevant zoning and building regulations.

Structure the paper to provide a clear, data-backed analysis of each point."

Originality.ai

Originality.ai AI Detector : 100% AI & 0% Human-written

Grammarly AI

Grammarly AI Score: 93% AI & 7% Human-written

AI Content Sample 3: Promotional Emails

Prompt: "Craft a promotional email for a summerhouse company offering a 10% discount on first orders over $4,000. The email should emphasize the benefits of adding a summerhouse to a garden, such as creating a functional and stylish space for work or leisure. Highlight the limited-time nature of the offer and encourage immediate action. The tone should be warm, persuasive, and focused on the value and quality of the summerhouses, with a clear call to action to use the discount code at checkout."

Originality.ai

Originality.ai AI Detector : 100% AI & 0% Human-written

Grammarly AI

Grammarly AI Score: 71%% AI & 29% Human-written

Findings from our Grammarly AI detector analysis with ChatGPT content samples

From the results of this test, the Grammarly AI content detector demonstrated strong capabilities when it was faced with some of the most basic AI content detection, such as marketing content for blog posts.

However, when it came to slightly more complex content, such as promotional emails, where language patterns differ, and the text is shorter, Grammarly’s AI detector struggled compared to Originality.ai.

Searching for more AI detector reviews? Check out our guide on the Best AI Content Detection Tools Reviewed.

Want some additional insight into the efficacy of Originaltiy.ai’s AI detector, check out our meta-analysis of third-party studies.

Further Reading on Grammarly

Looking for further insight into Grammarly? Check out our collection of Grammarly resources:

FAQs About AI Detection Tools and AI-Generated Content

Is Grammarly’s AI Content Detector free?

Grammarly’s AI content detector is free, and you don’t need a Grammarly account to use it. However, there is a word count limit for each submission.

What is Grammarly’s AI Detector?

Like other AI content detection tools, Grammarly’s AI detector is designed to identify AI-generated content and help users understand what content is human-written text and what isn’t.

Are AI-powered writing tools ethically okay to use?

When used sparingly, in the right context, and with transparency, AI writing tools have the power to be extremely beneficial, helping improve productivity and efficiency. However, when used to try and pass off AI work as your own, ethics comes into question.

Graeme Whiles

My name is Graeme, a passionate writer with a strong Content Marketing background. Over the last seven years, I have developed an extensive portfolio of SEO Content writing, helping various brands improve their organic traffic, customer experience, and, ultimately, profits!

Frequently Asked Questions

Do I have to fill out the entire form?

No, that’s one of the benefits, only fill out the areas which you think will be relevant to the prompts you require.

Why is the English so poor for some prompts?

When making the tool we had to make each prompt as general as possible to be able to include every kind of input. Not to worry though ChatGPT is smart and will still understand the prompt.

In The Press

Originality.ai has been featured for its accurate ability to detect GPT-3, Chat GPT and GPT-4 generated content. See some of the coverage below…

View All Press
Featured by Leading Publications

Originality.ai did a fantastic job on all three prompts, precisely detecting them as AI-written. Additionally, after I checked with actual human-written textual content, it did determine it as 100% human-generated, which is important.

Vahan Petrosyan

searchenginejournal.com

I use this tool most frequently to check for AI content personally. My most frequent use-case is checking content submitted by freelance writers we work with for AI and plagiarism.

Tom Demers

searchengineland.com

After extensive research and testing, we determined Originality.ai to be the most accurate technology.

Rock Content Team

rockcontent.com

Jon Gillham, Founder of Originality.ai came up with a tool to detect whether the content is written by humans or AI tools. It’s built on such technology that can specifically detect content by ChatGPT-3 — by giving you a spam score of 0-100, with an accuracy of 94%.

Felix Rose-Collins

ranktracker.com

ChatGPT lacks empathy and originality. It’s also recognized as AI-generated content most of the time by plagiarism and AI detectors like Originality.ai

Ashley Stahl

forbes.com

Originality.ai Do give them a shot! 

Sri Krishna

venturebeat.com

For web publishers, Originality.ai will enable you to scan your content seamlessly, see who has checked it previously, and detect if an AI-powered tool was implored.

Industry Trends

analyticsinsight.net

Frequently Asked Questions

Why is it important to check for plagiarism?

Tools for conducting a plagiarism check between two documents online are important as it helps to ensure the originality and authenticity of written work. Plagiarism undermines the value of professional and educational institutions, as well as the integrity of the authors who write articles. By checking for plagiarism, you can ensure the work that you produce is original or properly attributed to the original author. This helps prevent the distribution of copied and misrepresented information.

What is Text Comparison?

Text comparison is the process of taking two or more pieces of text and comparing them to see if there are any similarities, differences and/or plagiarism. The objective of a text comparison is to see if one of the texts has been copied or paraphrased from another text. This text compare tool for plagiarism check between two documents has been built to help you streamline that process by finding the discrepancies with ease.

How do Text Comparison Tools Work?

Text comparison tools work by analyzing and comparing the contents of two or more text documents to find similarities and differences between them. This is typically done by breaking the texts down into smaller units such as sentences or phrases, and then calculating a similarity score based on the number of identical or nearly identical units. The comparison may be based on the exact wording of the text, or it may take into account synonyms and other variations in language. The results of the comparison are usually presented in the form of a report or visual representation, highlighting the similarities and differences between the texts.

String comparison is a fundamental operation in text comparison tools that involves comparing two sequences of characters to determine if they are identical or not. This comparison can be done at the character level or at a higher level, such as the word or sentence level.

The most basic form of string comparison is the equality test, where the two strings are compared character by character and a Boolean result indicating whether they are equal or not is returned. More sophisticated string comparison algorithms use heuristics and statistical models to determine the similarity between two strings, even if they are not exactly the same. These algorithms often use techniques such as edit distance, which measures the minimum number of operations (such as insertions, deletions, and substitutions) required to transform one string into another.

Another common technique for string comparison is n-gram analysis, where the strings are divided into overlapping sequences of characters (n-grams) and the frequency of each n-gram is compared between the two strings. This allows for a more nuanced comparison that takes into account partial similarities, rather than just exact matches.

String comparison is a crucial component of text comparison tools, as it forms the basis for determining the similarities and differences between texts. The results of the string comparison can then be used to generate a report or visual representation of the similarities and differences between the texts.

What is Syntax Highlighting?

Syntax highlighting is a feature of text editors and integrated development environments (IDEs) that helps to visually distinguish different elements of a code or markup language. It does this by coloring different elements of the code, such as keywords, variables, functions, and operators, based on a predefined set of rules.

The purpose of syntax highlighting is to make the code easier to read and understand, by drawing attention to the different elements and their structure. For example, keywords may be colored in a different hue to emphasize their importance, while comments or strings may be colored differently to distinguish them from the code itself. This helps to make the code more readable, reducing the cognitive load of the reader and making it easier to identify potential syntax errors.

How Can I Conduct a Plagiarism Check between Two Documents Online?

With our tool it’s easy, just enter or upload some text, click on the button “Compare text” and the tool will automatically display the diff between the two texts.

What Are the Benefits of Using a Text Compare Tool?

Using text comparison tools is much easier, more efficient, and more reliable than proofreading a piece of text by hand. Eliminate the risk of human error by using a tool to detect and display the text difference within seconds.

What Files Can You Inspect with This Text Compare Tool?

We have support for the file extensions .pdf, .docx, .odt, .doc and .txt. You can also enter your text or copy and paste text to compare.

Will My Data Be Shared?

There is never any data saved by the tool, when you hit “Upload” we are just scanning the text and pasting it into our text area so with our text compare tool, no data ever enters our servers.

Software License Agreement

Copyright © 2023, Originality.ai

All rights reserved.

Redistribution and use in source and binary forms, with or without modification, are permitted provided that the following conditions are met:

  1. Redistributions of source code must retain the above copyright notice, this list of conditions and the following disclaimer.

  1. Redistributions in binary form must reproduce the above copyright notice, this list of conditions and the following disclaimer in the documentation and/or other materials provided with the distribution.

THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS “AS IS” AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.

Will My Data Be Shared?

This table below shows a heat map of features on other sites compared to ours as you can see we almost have greens across the board!

More From The Blog

Al Content Detector & Plagiarism Checker for Marketers and Writers

Use our leading tools to ensure you can hit publish with integrity!