AI Scrape Protect
Daan VerbaanAI Scrape Protect is a WordPress plugin designed to protect your website from scraping for AI training purposes. It achieves this by adding opt-out instructions to the robots.txt
file for the most common AI scraping bots.
Note: These instructions are not always respected by all bots.
Features
- Adds specific
User-agent
andDisallow
rules to yourrobots.txt
file to block a comprehensive list of AI scraping bots. - Introduces meta tags in the HTML
<head>
to provide additional instructions to AI bots.
License
This plugin is licensed under the GNU General Public License v2 or later. See the GPL v2 license for details.
Author Information
This plugin is developed by Uisce Web Development, specifically by Daan Verbaan. For support or inquiries, please visit our website or contact us directly.
The plugin adds specific User-agent
entries to your robots.txt
file to instruct common AI scraping bots not to crawl or scrape your site. It also introduces meta tags in the HTML <head>
to provide additional instructions to AI bots.
While this plugin adds recommendations to the robots.txt
file and includes meta tags, not all bots follow these rules. This is a measure to discourage scraping rather than a foolproof solution.
Currently, the plugin includes a predefined list of bots. If you need to add or remove specific bots, you would need to modify the plugin code or contact the plugin author for customization.
The robots.txt
file will revert to its previous state before the plugin was activated, and the meta tags added to the HTML <head>
will be removed.
2.1
- Updated Features section in
readme.txt
to include new functionality for meta tags in HTML<head>
. - Updated Frequently Asked Questions section in
readme.txt
to include new functionality for meta tags in HTML<head>
.
2.0
- Added AI bots: AI2Bot, AmazonBot, Applebot-Extended, ClaudeBot, OAI-SearchBot, PetalBot, webzio.
- Introduced meta tags for AI bot protection in HTML
<head>
.
1.4
- Added new AI bots to the
robots.txt
block list.
1.3
- Added new AI bots to the
robots.txt
block list.
1.2
- Plugin now uses
robots_txt
filter. - Removed settings page.
1.1
- Made classes more specific by adding 4 character prefixes.
1.0
- Initial release.
- Upload the
ai-scrape-protect
folder to the/wp-content/plugins/
directory. - Activate the plugin through the ‘Plugins’ menu in WordPress.
Reviews
0 out of 5 stars
- Version: 2.1
- Last updated: 2 weeks ago
- Active installations: 10
- WordPress version: 5.0
- Tested up to: 6.6.2
- PHP version: 7.4