The New York Times blocks OpenAI’s web crawler: The NYT’s robot.txt page that controls how it appears to automated bots built to index the internet now specifically disallows OpenAI’s GPTBot.

The New York Times blocks OpenAI’s web crawler: The NYT’s robot.txt page that controls how it appears to automated bots built to index the internet now specifically disallows OpenAI’s GPTBot.
https://www.theverge.com/2023/8/21/23840705/new-york-times-openai-web-crawler-ai-gpt
#ai #artificialintelligence #Tech #Policy #technology #chatgpt #openai