AI technology is finding increasing applications in many fields, such as customer service, e-commerce, and analytics. One of its more discussed uses recently is in content marketing and journalism. AI-powered tools can create entire articles, essays, and blog posts on a given topic.
A large part of the discussion are ethical concerns like plagiarism and authenticity of the content. Some people take issue with the fact that people can now use AI tools for content generation instead of taking the time to create original, well-thought-out pieces of writing.
Because of these issues, developers have found a new use for AI technology: AI content detection. Tools now exist that can identify whether or not a piece of content is generated using AI.
One such tool is Draft & Goal’s AI Content Detector. It is a free tool that can detect AI footprints in English and French texts. According to Draft & Goal, this tool works on ChatGPT, GPT-3, and GPT-3.5.
Draft & Goal is a new company working to create an automated production workflow app for AI content. This workflow includes getting instant insights, discovering new keywords, creating topic clusters, and generating content with AI.
However, Draft & Goal also believes in using ethical AI, meaning that AI should not be leveraged for deceptive or malicious purposes. This is where its free AI Content Detector comes into play.
Let’s explore its AI content detection tool further and see how it performs.
Draft & Goal’s features, including AI content detection, are all currently available for free. It’s unclear whether this will be the case forever, but Draft & Goal mentioned they are working to keep the tools free for all.
It should be noted that Draft & Goal’s AI Content Detector is still in beta mode, which is why it encourages users to leave feedback. Whenever the tool completes an analysis, it asks the user whether it guessed right.
We tested Draft & Goal’s tool using GPT-3 content samples of under 500 words. These texts were created through Jasper, one of the most popular AI writing tools today, trusted by over 100,000+ teams.
The results will be compared with results by Originality.ai. This is another AI content detection tool that gives probability scores and is trained on the same models as Draft & Goal. Let’s see how they fared.
As this table shows, Draft & Goal would’ve had the upper hand if it were not for the false positives. It returned three samples as 0%, suggesting a human most likely created them. The rest of its scores return high probabilities, from 86% to 99%.
In contrast, Originality.ai’s highest probability score is 100%, meaning it can catch entire articles created by a machine. The lowest score it produced in this test is 2%, which suggests refinement is still possible.
Language models are becoming increasingly better at producing content challenging to discern from human-generated pieces. But they aren’t perfect yet.
The same is true with AI content detectors. No app is 100% accurate, at least not yet. So part of the measure of accuracy is how well the tool catches AI-generated content while avoiding false positives.
Originality.ai is the clear winner in this test since it has the higher average detection score.
Since the Draft & Goal AI Content Detector is still in beta mode, it will be interesting to see how it evolves. It can potentially become an invaluable tool for journalists, editors, and teachers worldwide.
Based on the samples, the tool is very much capable of detecting completely AI-generated content. However, it is only partially reliable at this stage because of the false positives.
There is enormous potential in the multilingual support feature. Most AI content detection apps today only focus on English, meaning AI content written in other languages may still go unnoticed and be used for inappropriate purposes.
Because of the 400-character minimum limit, the tool may not be suitable for checking copywriting and short-form content, such as tweets. This could be improved over time, considering AI writing tools can generate short-form content too.
For now, users can help improve the tool by experimenting with it and giving feedback. This is also what ChatGPT is currently doing. The more feedback the tool gets, the better it will become at detecting AI-generated content and providing accurate insights into potential issues.
Draft & Goal’s AI Content Detector is a free tool to detect AI footprints in English and French texts. It is still in beta mode, but it has great potential. Draft & Goal has stated on its website that it strives to keep its tools free for all, so it is worth watching this tool to see how it will further develop.
In the meantime, users can use it sparingly and help provide feedback. As always, never use an AI content detection tool as a single source of truth. It should always be used with manual content review and other AI detection apps for the best results.
