AdvertisementThe world's top two AI startups are ignoring requests by media publishers to stop scraping their web content for free model training data, Business Insider has learned.
OpenAI and Anthropic have been found to be either ignoring or circumventing an established web rule, called robots.txt, that prevents automated scraping of websites.
TollBit, a startup aiming to broker paid licensing deals between publishers and AI companies, found several AI companies are acting in this way and informed certain large publishers in a Friday letter, which was reported earlier by Reuters.
The letter did not include the names of any of the AI companies accused of skirting the rule.
This story is available exclusively to Business Insider subscribers.
Persons:
—
Organizations:
Service, Business, Reuters