AI content. It's one of the most fiercely debated topics across all elements of content creation and a topic that we obviously feel strongly about!
With so much content getting generated through one AI tool or another, it can be hard for readers to trust their sources or fairly assess the quality of work.
That's where AI detectors come into play. But Originality.ai's AI detector is not the only one available, and it isn't the one that we will be looking at today.
Instead, we will be taking an impartial look at Scribbr's AI detection tool to see whether or not it is one you could consider using. To see a complete analysis or conduct your own AI detector accuracy review see this guide.
Here, we will focus on the following:
Originally, Scribbr operated as a plagiarism checker, which used its own unique plagiarism detection software to detect plagiarism in academic work and help maintain academic integrity. However, since the rise of AI content generation, Scribbr moved past just detecting plagiarism by offering an AI detection tool as well.
So, while we are not here to do a Scribbr plagiarism checker review, we will be diving a little deeper into its AI detection capabilities.
The Scribbr plagiarism checker is widely respected, so it will be interesting to see if the AI detection tool is of the same calibre.
As mentioned, AI content is becoming more prevalent each day, and while we here at Originality.ai certainly feel it has a place in content, there are also times when it does not, and transparency over the use of AI is incredibly important.
The era of misinformation and plagiarism is a scary one, but the Scribbr AI detection tool claims to help remove some of that fear by helping users detect AI content and maintain transparency over content created.
But does it work?
Now, let's get to the bit you've all come to find out. Does Scribbr's detection tool actually work?
Well, to find out, we've decided to put it through some rigorous testing alongside the Originality.ai content detection tool to see if they can detect the AI-generated content we create.
As with all of our articles, we feel it important to implement first-hand research and tests to ensure we provide you with the clearest and most unbiased opinions possible.
Quick note: This article is not paid for by Scribbr, and all of the results you see are based purely on the tests we have created, and not impacted by any form of sponsorship or outside influence.
For this test, we will create a few fake scenarios where AI content is likely prominent, creating content via ChatGPT, as this is the most widely used AI tool.
We will then run that AI-generated content through Originality.ai and Scribbr to see whether or not the two tools can detect that the content is AI-generated.
For this test, it's important to create a variety of types of content to ensure the test is as thorough as possible, which is why we will be generating a blog post, a product description, a promotional email, and a cover letter.
Firstly, let's put both tools to the test with a blog post for a fictional garden furniture company.
Here's our ChatGPT prompt:
"Generate a captivating blog post exploring the fusion of style and functionality in garden furniture with a focus on 'Garden Glow Up.' Cover the latest design trends, quality craftsmanship, versatile furniture options, sustainable material choices, and tips for accessorizing outdoor spaces. Craft an engaging narrative that inspires readers to transform their gardens into inviting retreats with Garden Glow Up's premium collection."
And here's what ChatGPT created:
Now we have our AI-generated content, let's run it through Originality.ai's AI detector and Scribbr and see what they think!
Originality.ai Score: 100% AI-generated
Try it yourself here: https://originality.ai/ai-checker
Scribbr Score: 0% AI-generated
Worryingly, while Originality.ai detects the content as 100% AI-generated, Scribbr actually states there is a 0% chance of it being AI-generated, which is completely incorrect.
Okay, so now let's look at a product description instead to see if Scribbr has more success with this form of content.
Here's our ChatGPT prompt:
Generate a compelling product description for Garden Glow Up's latest outdoor bench, striking the perfect balance between style and comfort. Highlight the bench's unique design features, premium craftsmanship, and versatile functionality. Emphasize its ability to seamlessly blend into various outdoor spaces, creating an inviting and stylish focal point. Craft a description that resonates with the audience, evoking a desire to enhance their gardens with this exceptional bench from Garden Glow Up.
And here's what ChatGPT produced:
Now we have our AI-generated content, let's run it through Originality.ai and Scribbr and see what they think!
Originality.ai Score: 100% AI-generated.
Scribbr Score: 0% AI-generated
Once again, Scribbr doesn't detect any AI-generated content, which is simply not the case.
Next, let's move on to a promotional email for this new product.
Here's our ChatGPT prompt:
"Generate a compelling promotional email for Garden Glow Up's latest outdoor furniture collection. Craft a message that highlights exclusive deals, introduces new arrivals, and emphasizes the premium quality and stylish design of the products. Invoke a sense of urgency and excitement to drive engagement and encourage recipients to explore the Garden Glow Up website for a transformative outdoor experience. Ensure the email is visually appealing, concise, and resonates with the audience's desire for a sophisticated and comfortable outdoor haven."
And here's what we got in return:
Now we have our AI-generated content, let's run it through Originality.ai and Scribbr and see what they think!
Originality.ai Score: 100% AI-generated
Scribbr Score: 0% AI-generated
Okay, so Scribbr may not be the best detection tool for AI-generated marketing copy. But what about other forms of copy, such as a work cover letter?
Here's our ChatGPT prompt:
"Generate a compelling cover letter for a position at Garden Glow Up, expressing enthusiasm for the company's commitment to outdoor elegance and a passion for creating inviting spaces. Highlight relevant skills, experience, and personal attributes that align with the company's values. Emphasize the desire to contribute to Garden Glow Up's success and play a key role in shaping memorable outdoor experiences for customers. Craft a letter that showcases a strong work ethic, creativity, and a genuine connection to the mission and ethos of Garden Glow Up."
Here's what we got back:
Now we have our AI-generated content, let's run it through Originality.ai and Scribbr and see what they think!
Originality.ai Score: 100% AI-generated
Scribbr Score: 95% AI-generated
As you can see, Scribbr is much more accurate with our cover letter example than any marketing content we created.
So while the free plagiarism checker might be a great tool for identifying potential plagiarism, it might be worth avoiding the AI detection tool for now until it improves, unless you are using it for content that is not created for marketing purposes.
Unlike Scribbr's plagiarism checker, their AI detection tool is free to use.
Originally, Scribbr operated as a plagiarism checker, which used its own unique plagiarism detection software to detect plagiarism in academic work and help maintain academic integrity. However, since the rise of AI content generation, Scribbr moved past just detecting plagiarism by offering an AI detection tool as well.
The easiest way to make your AI content undetectable is to use the software sparingly. While there are tools that claim to generate AI content that bypass detection tools like Scribbr or Originality.ai, from our research, we have found that these tools tend to be well below par or don't work at all!
When it comes to maintaining your academic integrity and credibility, it's important to use AI-powered tools sparingly and transparently. Much like plagiarism checkers, high-quality AI content detectors will know if you have attempted to pass off AI-generated work as your own, which could lead to more serious punishment, depending on the circumstances.