OpenAI launched a new web crawler called GPTBot to browse the internet and collect information.
However, adding one line of code to a website will block the crawler from accessing the site's data.
Adding just one line of code to a website will now block OpenAI from using the site's data to train its AI models.
A web crawler is a bot that browses the internet to collect information.
Search engines like Google use web crawlers to collect information for their search results, while AI companies use these crawlers to collect data to train their models.
Persons:
OpenAI, Michael Veale, ChatGPT —, James Patterson, Margaret Atwood —
Organizations:
Morning, University College London, MIT Technology, OpenAI