AI Writing

Do Humanize AI GPTs Work To Bypass AI Detectors?

Explore the world of specialized GPT models in ChatGPT's GPT Store. Discover humanizer models and delve into their impact on AI content detection.

Jonathan Gillham

With the launch of ChatGPT’s GPT Store, users can now access GPT models that are fine-tuned for specific types of assistance. Ranging from creative writing to legal advice, technical coding and even medical information, these specialized GPTs go well beyond the ordinary ChatGPT model. 

In the two months since the announcement that would allow ChatGPT users to create custom versions of the program, numerous builders from a variety of backgrounds and specialties have shared their creations with others.

Not surprisingly, some of the most popular GPTs are “humanizers”. Humanizers are designed to subvert the robotic “AI-sounding” GPT writing and replace it with content that sounds more human. 

But are these “human-style” models really able to create undetectable AI content? 

We put them to the test.

Meet the Contenders

We chose the most popular GPTs from the Writing section of the GPT store, including Humanize AI and Humanizer Pro.

most popular GPTs from the Writing section of the GPT store

How We Tested:

For this quick test, we took five known AI samples from our AI detection benchmark dataset. We then ran the text through Humanize AI and let Originality.AI check it for authenticity. We then repeated these steps with Humanizer Pro. 

For those of us who work every day to uncover AI-generated writing, the results were hardly surprising. 

Results of Humanizer GPTs on Originality.ai

As a baseline measurement, we ran the default AI detection test through Originality.AI. It guessed that all five samples were correctly AI-generated, as expected: 

ChatGPT Generated Text:

  • Sample 1 - 100% AI
  • Sample 2 - 100% AI
  • Sample 3 - 100% AI
  • Sample 4 - 100% AI
  • Sample 5 - 100% AI

We then took the original AI-generated samples and ran them through Humanize AI from the GPT Store. After the text was “humanized”, we fed it back into Originality.AI  with these AI detection results: 

Humanize AI Modified Text:

  • Sample 1 - 97% AI
  • Sample 2 - 100% AI
  • Sample 3 - 100% AI
  • Sample 4 - 100% AI
  • Sample 5 - 100% AI

We repeated the same steps above but for the second test, we ran the AI-generated text through Humanizer Pro. After being humanized by that particular GPT, we then fed the text to Originality.AI with these results: 

Humanizer Pro Modified Text:

  • Sample 1 - 100% AI
  • Sample 2 - 100% AI
  • Sample 3 - 100% AI
  • Sample 4 - 100% AI
  • Sample 5 - 100% AI
Results of Humanizer GPTs on Originality.ai

See raw data here.

Summary

It’s understandable to want some kind of shortcut that will differentiate AI-generated writing and make it sound more human. Unfortunately, our tests proved that even with these specialized GPTs, AI still has a long way to go before it can sound authentically human-like. As new iterations of these “humanizing” GPTs are released, we’ll repeat and update our tests accordingly.

However, as of right now, even specialized GPTs from the GPT store that promise to “humanify” your text will fall short when put through their paces with true AI detection software. If you’re thinking of using a humanizing GPT to make content undetectable, think twice, as the best AI writing detectors can still pick up on it with nearly 100% accuracy each and every time.

Jonathan Gillham

Founder / CEO of Originality.AI I have been involved in the SEO and Content Marketing world for over a decade. My career started with a portfolio of content sites, recently I sold 2 content marketing agencies and I am the Co-Founder of MotionInvest.com, the leading place to buy and sell content websites. Through these experiences I understand what web publishers need when it comes to verifying content is original. I am not For or Against AI content, I think it has a place in everyones content strategy. However, I believe you as the publisher should be the one making the decision on when to use AI content. Our Originality checking tool has been built with serious web publishers in mind!

More From The Blog

AI Content Detector & Plagiarism Checker for Serious Content Publishers

Improve your content quality by accurately detecting duplicate content and artificially generated text.