How well do AI detectors actually work? These tools promise to determine if a piece of text was crafted by a human or AI text generators. But before we take their word for it, I started wondering: Just how accurate are these detectors?
OpenAI recently pulled their AI text classifier because it wasn’t quite up to the task. This got me thinking—could other AI detectors be just as unreliable? To get to the bottom of this, I decided to test them myself.
I took an old piece of my own writing and had ChatGPT generate a completely new one. Then, I put both through various AI detectors to see if they could tell the difference.
Keep reading to find out if these AI tools can really distinguish between human-written and AI-generated text.
What is an AI detector?
Before we dive into the tools, let’s clear up what an AI detector is.
An AI detector is software that uses machine learning to spot and classify content generated by aritficial intelligence.
These tools are pretty new and were created to deal with the rise of AI-generated stuff like essays, images, videos, and even music. They work by analyzing different features and patterns that are unique to AI-created content.
Top AI detector tools to check out in 2024
Here are the AI detectors I’ve tested so far in 2024:
Originality.AI – AI detector with Wide NLP model support
Let’s kick things off with Originality.ai. This AI detector is all over the place right now—I can’t escape the ads! They claim a 99% accuracy rate in detecting AI content.
To give it a go, I had to create an account and provide my credit card info. They give you 50 free credits, which is nice. Keep in mind, though, this tool only works with English text.
I decided to test it with a 500-word article I wrote a few years back. The result? Originality.ai said it was 96% human and 4% AI. Not bad, but considering I wrote the whole thing myself, it’s not quite perfect either.
Next I try a ChatGPT article of around the same length. Originality.ai correctly identifies that the writing was 100% AI written. So all in all, this tool is pretty accurate in my opinion!
originality.ai features
- Wide NLP Model Support: This tool works with various NLP models, making it compatible and effective across different frameworks.
- Team Collaboration: Multiple team members can use the tool together, making it easy to share insights and analyze content efficiently.
- Future Enhancements: The team is working on a full site scan feature, which will allow the tool to scan entire websites for AI-generated content and plagiarism.
- APIs and Integrations: Originality.ai offers APIs and integration options, so you can easily add it to your existing workflows and systems.
- Cost-Effective: It’s an affordable tool that doesn’t skimp on features, providing great value for different budget needs.
Turnitin – AI detector with educational focus
Let’s dive into Turnitin’s AI Writing Detection tool. Given its relevance to educational institutions, I decided to test it out. Signing up was straightforward and didn’t require a credit card upfront, which was convenient.
I appreciated that this tool supports multiple languages, making it a versatile option for diverse student bodies and faculty. This made it one of the more reliable ai essay detectors out there.
I started by uploading an essay I wrote recently for a project. Turnitin’s AI detection results came back showing it as 98% human-generated and 2% AI-generated. Not perfect, but close enough since the essay was entirely my own work.
Next, I uploaded a creative story generated by ChatGPT. Turnitin nailed it, identifying the text as 100% AI-generated. Overall, I was quite impressed by its accuracy and reliability.
Turnitin features
1. Wide Language Support: This tool supports various languages, making it suitable for a diverse, global audience.
2. Educational Focus: Designed with educators in mind, Turnitin offers features tailored for academic settings, aiding both teachers and students in maintaining academic integrity.
3. Continuous Improvement: The team behind Turnitin is dedicated to enhancing the tool, regularly adding new features to better detect AI-generated content and prevent plagiarism.
4. APIs and Integrations: Turnitin provides robust APIs and integration options, making it easy to incorporate into existing educational and professional workflows.
5. Accessible Pricing: Turnitin offers cost-effective solutions, ensuring institutions of all sizes can benefit from its powerful features without breaking the bank
Winston AI – AI Detector with sentence highlighting
Another popular AI writing detector is Winston. Once again, I have to create a free account in order to use the tool, though I appreciate that I don’t need to hand over any credit card details at this stage. I’m given a number of credits to use, more than enough for the purpose of this article.
Winston also automatically gives you a free 7 day trial, after which you’ll need to upgrade in order to keep using the tool, even if you still have free credits left. Plans start from $12/month which will allow you to scan 80,000 words each month for both AI and plagiarism checking.
This time I start with my human generated content. I like that I can test the full 500 word article this time. The score they give me is 75% human generated, while 25% is likely AI. Interesting. Looking at the results, they’ve highlighted the sections they believe to be likely generated by AI, I don’t agree with the assessment, but there you go.
Next, onto the AI generated content. Winston accurately detects that the text was written by AI, giving me a measly score of 1% human generated. Overall, I don’t think Winston is as accurate as it claims to be, and Originality seems a more capable tool at this stage.
Winston features
- ChatGPT Compatibility: The tool seamlessly works with ChatGPT, including the latest GPT-4 model, enabling accurate detection of AI-generated text from these advanced language models.
- Sentence Highlighting: Winston AI’s advanced capabilities include the ability to highlight sentences that are likely to have been generated by AI. This feature provides users with a clear visual representation of AI-generated content within their text.
- Handling Large Documents: Winston AI has the capacity to efficiently scan and analyze extensive documents, including books. It can process and assess content in various formats, allowing users to upload complete files in .word, .pdf, and even scanned documents.
- Plagiarism Detection: In addition to AI detection, Winston AI offers plagiarism detection capabilities, helping users identify potential instances of copied content and providing sources for proper attribution.
- Free Readability Score: Winston AI goes beyond AI detection and plagiarism checks by providing users with a free readability score. This feature assesses the readability and comprehension level of the text, offering valuable insights for content improvement.
Copyleaks – AI Detector with source code checking
Alrighty, let’s check out Copyleaks’ AI text detector next. Again, I don’t need to sign up which I appreciate. I can simply copy and paste my text straight into the tool.
I start with my human generated content. This time I’m not given a score. Instead, Copyleaks simply tells me that my text is human generated text. While this is accurate, I kinda liked seeing what my score was and which sentences the detector thought might be AI generated. Oh well, never mind.
Let’s see how the AI generated text does. This time, I see the bulk of my article highlighted in red. The detector has accurately detected that my text was machine generated. Though interestingly it thinks my first paragraph is at least 40% human.
Copyleaks features
- AI-Powered Features: Copyleaks harnesses the power of AI to deliver its functionality, ensuring accurate and efficient detection capabilities.
- Comprehensive NLP Model Coverage: The tool covers all major NLP models, including the advanced GPT3.5 model. This broad coverage enables users to detect AI-generated content effectively.
- APIs for Scalable AI Content Detection: Copyleaks provides APIs that facilitate large-scale AI content detection, allowing seamless integration into existing systems and workflows.
- Chrome Extension Support: The tool offers a convenient Chrome extension, making it easily accessible for users while browsing the web. This extension enhances the user experience and enables on-the-go content detection.
- Robust Plagiarism Checker: Copyleaks features a powerful plagiarism checker that thoroughly scans content to identify instances of copied or unoriginal text, ensuring content integrity.
- Source Code Checking: In addition to text-based content, Copyleaks includes source code checking functionality, enabling users to detect similarities or plagiarism in code snippets and programming files.
- LMS Integration: Copyleaks facilitates integration with Learning Management Systems (LMS), allowing educational institutions and e-learning platforms to seamlessly incorporate content detection capabilities into their systems.
Content at Scale – AI detector with free software usage
The final tool I’m testing today is Content at Scale. This free AI detector claims to be 85% accurate (a little more modest than other AI detectors mentioned in this article).
This time I start with my AI article. The detector gives me a score of 31% human written. Not an awful assessment, but not entirely accurate either. Unfortunately none of the sentences are highlighted so I can’t tell which parts are assumed to be AI and which parts could be human.
Next I plug in my human generated article. I receive a perfect 100% score! The detector accurately confirms that the text was written by flesh and bones. Excellent.
Content at Scale features
- On-Demand API Access: The API is readily available upon request, allowing users to integrate the software seamlessly into their existing systems and workflows.
- Extensive Language Support: The software provides support for multiple languages, enabling users to analyze text in various linguistic contexts.
- Free Software Usage: Users can utilize the software free of charge, making it accessible to a wide range of individuals and organizations.
- High Reliability and Accuracy: The software consistently delivers reliable and accurate results, ensuring users can depend on its output for their text analysis needs.
GPTZero – AI detector with comprehensive language assistance:
Next up on my list is GPTZero. This AI detector claims to be the ‘gold standard in AI detection’ and aims to bring transparency to humans navigating a world filled with AI-generated content. Let’s see how it goes with my human generated content.
When I paste in my human-written article GPT zero passes it with flying colors. 100% human generated – correct!
Next I plug in the AI generated article. I’m given a rating of 87% AI generated which is pretty decent. Interesting that it thinks it was a mix of human and AI though…it was definitely 100% the robot!
GPTZERO features
- API Access on Demand: You can easily access the API whenever you need it, facilitating effortless integration into your current systems and processes.
- Comprehensive Language Assistance: The software offers robust support for numerous languages, enabling users to analyze text across diverse linguistic scenarios.
- No-Cost Software Utilization: Users have the freedom to employ the software without incurring any charges, enhancing its accessibility to a broad spectrum of individuals and organizations.
- Consistent Precision and Dependability: The software consistently provides dependable and precise results, guaranteeing users can rely on its output for their text analysis requirements.
Content Detector – AI detector with enhanced browsing
Alrighty moving on to the next AI detector, the aptly named ‘Content Detector’. This tool is completely free to use which is pretty cool. I couldn’t find any options to upgrade to a plan on their website.
To mix things up I pop in my AI article first. This tool spits back a score of 64% probability – not very accurate if you ask me!
Next up, I try out my human article. This time I’m given a reassuring ‘entirely human’ response, however, that’s not reflected in my score of 32% probability of AI – a little odd if you ask me.
Content Detector features
- Utilizing AI-Powered Capabilities: Content Detector harnesses the capabilities of artificial intelligence to ensure accurate and efficient detection, enhancing its functionality.
- Inclusive NLP Model Support: The tool encompasses a wide array of major NLP models, including the advanced GPT 3.5 model, enabling users to effectively identify AI-generated content.
- Enhanced Browsing with Chrome Extension: The tool conveniently provides a Chrome extension, granting users easy access while browsing the web. This extension improves user experience and facilitates on-the-fly content detection.
- Robust Plagiarism Detection: Content Detector incorporates a potent plagiarism checker that meticulously scans content to pinpoint instances of copied or unoriginal text, safeguarding content integrity.
Sapling – AI detector with upgradable features
The next cab off the rank is Sapling. This AI detector is free to use, however, they also have the option to upgrade to a pro plan for $25/month. This plan includes other features as well as the AI detector.
But for our intents and purposes, I just tried out the free version of the AI detector. When I paste in my human-written article I receive a score of 0.7% fake which is pretty darn good!
And unsurprisingly, when I paste in my AI article I’m given a perfect 100% AI-generated score!
Scribbr – AI detector with plagiarism detection
And lucky last, the final AI detector I’m testing today is Scribbr. Now normally you might save the best for last, but in this case, it’s the opposite! This tool didn’t actually work at all! Thinking it might have been my browser, I tried running the tests on both Safari and Chrome to no avail.
So it’s a bit difficult to rate the tool seeing as I couldn’t use it, but maybe you’ll have better luck than me!
How to choose the best AI detector for your needs
Choosing the best AI detector for identifying AI-generated content can be a complex task since this technology is continuously advancing. Here are some key considerations to help you make an informed choice:
- Assess Accuracy: Look for detectors with a proven track record of accuracy. Check for published results, benchmarks, or independent evaluations of the tool’s performance in identifying AI-generated content.
- Regular Updates: Ensure that the chosen detector is regularly updated to keep pace with the latest advancements in AI content generation.
- Manage False Positives and False Negatives: Evaluate how well the detector handles false positives (flagging genuine content as AI-generated) and false negatives (missing AI-generated content). Balance these aspects based on your specific needs.
- Integration and Usability: Consider how easily the AI detector can be integrated into your existing workflow or system. User-friendliness can be a significant factor, especially for non-experts.
- Compliance and Privacy: Ensure that the detector complies with legal and ethical standards regarding data privacy and usage.
- Cost: Consider the cost of the AI detector and whether it aligns with your budget. Some solutions may offer free or open-source options, while others require a subscription or one-time purchase.
- User Feedback and Recommendations: Seek input from other professionals in your field who may have similar needs. User reviews, recommendations, and discussions in online forums can provide valuable insights.
- Test Before Implementation: Whenever possible, test the AI detector with a sample of your data to gauge its performance in your specific context before making a final decision.
Keep in mind that while AI detectors are valuable tools, they may have limitations. It’s often wise to employ a combination of detectors and human review to enhance content identification accuracy, especially in critical applications.
Staying informed about the latest developments in AI-generated content and detection techniques is essential for maintaining effective detection strategies over time.
How to bypass AI detectors using non-traceable AI
Let’s explore some strategies to avoid detection of AI-generated content:
Tip #1: Diversify your writing process
When using ChatGPT or similar AI tools, it is advisable to break down your content into smaller segments and generate each section separately. This approach creates a more natural flow and reduces the likelihood of being flagged as machine-generated.
Taking the time to review and edit each segment further enhances the quality and reduces the chances of detection. Moreover, creating sections individually allows you to add nuances and variations commonly found in human conversation but not typically present in a single piece generated by an AI program.
Tip #2: Steer clear of repetition
To avoid detection, it’s important to avoid using recurrent phrases or structures when engaging with ChatGPT. AI-driven conversation often exhibits patterns and templates that lead to formulaic language, making it easier for detection tools to identify.
To counter this, strive for language diversity by varying your word choice and sentence structures. For instance, instead of repeatedly using the same sentence structure, use different connecting words or phrases.
Also, make an effort to avoid excessive repetition of words or phrases by using synonyms, antonyms, or related terms to convey the same idea without repeating yourself.
Lastly, don’t rely on clichés or common phrases and express ideas in your own words to avoid sounding formulaic.
Tip #3: Infuse personal experiences
Incorporating personal anecdotes or experiences into your AI-generated text can help avoid detection. This aligns with Google’s E-E-A-T principle (Experience, Expertise, Authority, and Trustworthiness), which emphasizes the importance of demonstrating expertise and credibility in content.
Sharing stories or experiences related to the subject matter establishes your knowledge and enhances the authenticity of the generated text.
Adding personal touches make the text more engaging, easier to connect with, and memorable. Such anecdotes can also serve as illustrative examples that support your main points or arguments.
Tip #4: Revise and rephrase
Utilizing tools like QuillBot can aid in rephrasing and revising AI-generated content without altering its core meaning. QuillBot is an AI-based writing tool specifically designed for paraphrasing and reworking written material.
By rewriting the text with tools like QuillBot, you can make it sound more natural and less robotic, thereby reducing the chances of it being identified as computer-generated content.
Simply input the generated text into the tool, select the desired level of rewriting, and QuillBot will produce a new version of the text that retains the original meaning but is expressed differently. This process can be repeated multiple times to generate completely new versions.
Tip #5: Verify with an AI detection tool
To ensure your content remains undetected, use a reliable AI detection tool such as Originality.ai.
This advanced algorithm-based system accurately identifies AI-generated content and plagiarism. By subjecting your generated text to analysis using Originality.ai, you can be confident that it will not be flagged as originating from an artificial intelligence source.
Simply copy and paste the text into the platform, and the system will generate a report highlighting any areas of plagiarism or machine-generated material that need to be addressed before using the content for its intended purpose.
This step guarantees the authenticity of your content and ensures it is not a mere copy of existing material.
By following these tips, you can significantly reduce the chances of AI detection and create content that is both original and indistinguishable from human-generated content.
Frequently asked questions (FAQs)
Are AI detectors accurate?
AI detectors can be highly accurate, but it depends on various factors such as the quality of the data used for training, the algorithm used, and the specific task the detector is designed for. AI detectors are typically trained using large datasets that include both positive and negative examples of the target object or behavior. The model learns patterns and features from these examples to make predictions on new data.
However, it’s important to note that AI detectors are not infallible. They can still make mistakes or produce false positives/negatives, especially in complex and nuanced situations.
Should I use an AI detector?
Whether or not you should use an AI detector depends on your specific needs, context, and considerations.
Determine if the task you need assistance with aligns with the capabilities of the AI detector. AI detectors are usually used for text analysis. Assess whether the detector can effectively address your requirements.
Evaluate the accuracy and reliability of the AI detector for your specific use case. Research and test the performance of the detector on relevant datasets or scenarios. Consider factors that might affect its accuracy, such as variations in input data or potential biases.
Which is the best AI detector?
Originality.AI stands out as a top-notch AI content detector that offers exceptional ease of use and remarkable accuracy. This powerful tool is specifically designed to scan text for instances of plagiarism, AI-generated content, and various manifestations of unoriginality. Whether you are a student, teacher, or business professional seeking to safeguard the authenticity of your content, Originality.AI proves to be an excellent choice.
What can AI detectors be used for?
AI detectors can be used for various purposes, including fraud detection, content moderation, spam filtering, malware detection, and identifying AI-generated content.
How do AI detectors work?
AI detectors typically use machine learning algorithms to analyze input data and identify specific features or patterns associated with the content they are designed to detect.
What types of AI-generated content can detectors identify?
AI detectors can identify various types of AI-generated content, including deepfake videos, generative text, synthetic images, audio deepfakes, and more.
How can I evaluate the accuracy of an AI detector?
Accuracy can be assessed through benchmarks, independent evaluations, and comparisons with ground truth data. Look for published performance metrics and results.
Can AI detectors be fooled?
Yes, AI detectors can be fooled or bypassed by sophisticated adversaries who intentionally manipulate content to evade detection.
Are there open-source AI detectors available?
Yes, there are open-source AI detectors and libraries available that can be used to detect specific types of content, such as deepfakes or fake news.
What industries benefit from AI detectors?
AI detectors are used in various industries, including cybersecurity, media and entertainment, finance, e-commerce, healthcare, and more.
Do AI detectors violate privacy?
The use of AI detectors should comply with privacy regulations and ethical standards. Some detectors may raise privacy concerns, depending on how they are used and the data they analyze.
Can AI detectors be customized for specific needs?
Yes, many AI detectors can be customized and fine-tuned for specific use cases or content types to improve their accuracy.
Do AI detectors require a lot of computational resources?
The computational requirements of AI detectors can vary. Some may run on standard hardware, while others, especially those designed for real-time applications, may require more powerful systems.
What are the limitations of AI detectors?
AI detectors may have limitations in detecting content generated by highly advanced AI models or in differentiating subtle manipulations from genuine content. They may also produce false positives or false negatives.
Are AI detectors a replacement for human review?
AI detectors are often used in conjunction with human review to enhance accuracy. Human judgment is crucial in many cases, especially when context and nuance are important.
Wrapping it up
In conclusion, AI detectors are becoming increasingly popular as AI technology becomes more integrated into our daily lives.
With the help of machine learning algorithms, AI detectors can analyze data and identify patterns or behaviors that are indicative of AI, but they aren’t always accurate. It’s best to use your own judgment and discernment when checking content to see if it is AI generated.