Industry Newsweb crawlingcontent licensingcloudflareweb economics
Cloudflare Blocks Billions of AI Scrapers
8.0
Cloudflare said during a recent earnings call that it blocked 416 billion AI bot scraping attempts over the past five months, after rolling out a one-click blocker in July 2025. The company, which protects about 20% of websites, also promotes pay-per-crawl licensing to let publishers monetize access. This move aims to curb unauthorized training-data collection and reshape web monetization dynamics.
Key Points
- 1Blocked 416 billion AI scraping attempts in five months, protecting roughly 20% of global websites
- 2Challenges search-driven revenue models by preventing unauthorized data harvesting that fuels generative AI training
- 3Encourages permission-based licensing and pay-per-crawl deals, requiring AI firms to secure paid access
Scoring Rationale
High industry relevance and official disclosure drive the score, but novelty is incremental within ongoing scraping debates.
Sources
Public references used for this report.
Practice interview problems based on real data
1,625 SQL & Python problems across 15 industry datasets — the exact type of data you work with.
Try 250 free problems
