Summary
- OpenAI’s web crawlers are not being blocked by news outlets as frequently as before
- The number of high-ranking media websites using robots.txt to block OpenAI’s GPTBot has decreased
- OpenAI has struck deals with 12 publishers, leading to a decrease in blocking rates
- There may be future spikes in blocking, but the trend towards partnerships with AI companies is reducing overall blocking behavior
