=== AI Scrape Protect === Contributors: daanverbaan Donate link: https://paypal.me/AiScrapeProtect Tags: robots.txt, scraping, AI, security, AI scraping protection Requires at least: 5.0 Tested up to: 6.8 Requires PHP: 7.4 Stable tag: 4 License: GPLv2 or later License URI: https://www.gnu.org/licenses/gpl-2.0.html Protect your website from AI scraping by adding opt-out instructions to your `robots.txt` file and including meta tags in the HTML `` with this easy-to-use WordPress plugin. == Description == **AI Scrape Protect** is a WordPress plugin designed to protect your website from scraping for AI training purposes. It achieves this by adding opt-out instructions to the `robots.txt` file for the most common AI scraping bots and including meta tags to control how your content is used. **Note:** These instructions are not always respected by all bots. == Features == - Adds specific `User-agent` and `Disallow` rules to your `robots.txt` file to block a comprehensive list of AI scraping bots. - Introduces meta tags in the HTML `` to provide additional instructions to AI bots, including new tags for Bingbot and general AI compliance. - Prepares for future standards with support for `DisallowAITraining` and `noimageai` meta tags. - Dedicated handling of specific bots like CCBot and Bingbot for better protection and compatibility. - Admin bar icon to indicate plugin activity. == Installation == 1. Upload the `ai-scrape-protect` folder to the `/wp-content/plugins/` directory. 2. Activate the plugin through the 'Plugins' menu in WordPress. == Changelog == = 4.0 = * Project URL and documentation moved from `uisce.eu` to [https://codesurf.eu](https://codesurf.eu) to reflect the new home of the plugin and its development. * All internal plugin references and support links updated accordingly. * No functional changes to code — purely branding and maintenance update. = 3.1 = * Added new AI bots to the block list: DuckDuckBot, OpenAIContentCrawler, YandexBot, NeevaBot, AIMatrixCrawler. * Improved admin bar icon clarity with higher resolution and visual indicators (green dot for active state). = 3.0 = * Added admin bar icon functionality to indicate plugin activity. * Updated meta tags for compliance with official documentation and improved AI scraping protection: - Adjusted Bingbot tag to use `nocache` for better compatibility with Bing AI Chat. - Removed "noindex" from the `ai-bot` meta tag to allow search engine indexing. - Added `DisallowAITraining` and `noimageai` to the `robots` meta tag. - Introduced dedicated meta tags for CCBot. * Removed OpenAI SearchBot from the `robots.txt` blocklist based on OpenAI's recommendations. = 2.4 = * Updated meta tags for improved AI scraping protection. - Prevent Bingbot and general AI bots from using the content for AI purposes. - Added clear comments in the code to describe the functionality of each meta tag. == Frequently Asked Questions == = How does this plugin protect my site from AI scraping? = The plugin adds specific `User-agent` entries to your `robots.txt` file to instruct common AI scraping bots not to crawl or scrape your site. It also introduces meta tags in the HTML `` to provide additional instructions to AI bots. = Will this completely stop AI scraping of my site? = While this plugin adds recommendations to the `robots.txt` file and includes meta tags, not all bots follow these rules. This is a measure to discourage scraping rather than a foolproof solution. = Can I add or remove bots from the list? = Currently, the plugin includes a predefined list of bots. If you need to add or remove specific bots, you would need to modify the plugin code or contact the plugin author for customization. = What happens if I deactivate the plugin? = The `robots.txt` file will revert to its previous state before the plugin was activated, and the meta tags added to the HTML `` will be removed. == Screenshots == 1. **robots.txt File Example:** Shows how the plugin updates the `robots.txt` file. 2. **meta tags Example:** Shows an example of the Meta Tags added to the head section. 3. **Admin Bar Icon:** Displays the admin bar icon indicating the plugin's active state. == Upgrade Notice == = 4.0 = All project links and references have been updated to reflect the plugin’s move from `uisce.eu` to its new home at `codesurf.eu`. No functional changes — safe to update. = 3.1 = New AI bots have been added to the block list, improving the scope of protection. The admin bar icon has been enhanced with a higher resolution and a green dot to clearly indicate when the plugin is active. = 3.0 = Admin bar icon added. Updates to meta tags and `robots.txt` for better compatibility with AI standards. Removed OpenAI SearchBot from the blocklist as recommended.