How to Prevent AI Bots from Scraping Your Website

[mcwetboy]

If you’d rather not have the content of your website used to train the AI models behind ChatGPT and the like, there are instructions on how to block the data-scraping bots using robots.txt or .htaccess files in your home directory. Here’s some from Neil Clarke, whose sf magazine Clarkesworld has been inundated by AI-generated submissions; here’s some more from Ars Technica. (This is all predicated on the assumption that the bots will obey what is essentially a request; some may not.)

Mirrored from Jonathan Crowe.