Policy & Ethicsweb crawlingcontent licensinggoogleregulation
UK CMA Forces Google Separate AI Crawlers
|
9.8
The UK’s Competition and Markets Authority has forced Google to separate its AI training crawler from its standard search crawler, a change implemented this month and described in Cloudflare’s analysis. Google now exposes a distinct Google-Extended agent that sites can block for AI training while preserving Google Search indexing. The move grants publishers new control over data licensing and may reshape global AI training practices.
Scoring Rationale
High regulatory novelty and broad industry impact; limited by incomplete public CMA report details and enforcement uncertainty.
Practice with real Ad Tech data
90 SQL & Python problems · 15 industry datasets
Used by DS/ML engineers at top companies
Active Search Campaigns by BudgetEasyHigh CPC Clicks & Poor Landing PagesMediumCampaign ROAS by Attribution ModelHard
250 free problems · No credit card
See all Ad Tech problems
