tech
OpenAI, Google, Microsoft and Anthropic Pledge Single Way for Publishers to Block AI Scraping
OpenAI, Google, Microsoft and Anthropic pledge a single way for publishers to block AI scraping
Key points
- Publishers currently need multiple blocking commands for every bot that crawls the web.
- Microsoft will implement the standard from February 1, 2027, and Google sometime in 2027.
- The new setting applies only to future model training and does not stop other crawling.
Why it matters. The solution will not fully take effect for months, and content scraping stays allowed by default until a publisher changes the setting.
OpenAI, Google, Microsoft and Anthropic pledged on Friday to give publishers a single standardized instruction that AI companies would honor to block scraping for training. Microsoft will implement it from February 1, 2027, and Google sometime in 2027, while OpenAI said it will roll it out in the coming months. The New York Times sued OpenAI and Microsoft in December 2023 over alleged use of millions of its articles without authorization.
Latest updates
OpenAI, Google, Microsoft and Anthropic Pledge Single Way for Publishers to Block AI Scraping
OpenAI, Google, Microsoft and Anthropic have pledged to offer media outlets and other websites one way to stop their content being scraped for training artificial intelligence models. At present, publishers must implement a separate blocking command for every bot that crawls the web to collect data. The commitment comes amid growing criticism of AI companies from news publishers. Several publishers are also involved in legal battles over the use of their content. The pledge was announced on Friday, October 31. The source does not specify a timeline for the new mechanism to take effect.
UK vows 100 mn euros for biosecurity lab with OpenAI, Anthropic, and Google
The United Kingdom is committing one hundred million euros, about one hundred thirty-four million dollars, to create a new artificial intelligence biosecurity laboratory. The facility will use AI to detect and monitor biological threats and will be supported by OpenAI, Anthropic and Google DeepMind. The government says the lab will also work with life sciences company Basecamp Research, while a separate sixty-five million euros will fund countermeasures for pathogens. The package includes up to two hundred million euros in AI model credits from OpenAI and Anthropic. For ordinary people, the stated goal is faster detection of emerging health threats and quicker development of medical treatments, which could mean earlier warnings and better protection during future outbreaks. Britain is also adding one hundred twenty million euros for its AI Security Institute and one hundred thirty million euros to find cyber weaknesses in critical infrastructure. The move positions the UK as a monitoring and safety hub while it trails the United States and China in building cutting-edge AI models.