Industry Newsweb crawlinggenerative aianthropicopenai
Anthropic and OpenAI Crawl Web With Low Referrals
|
8.1
Cloudflare data for the first week of January shows Anthropic and OpenAI sent far fewer referral visits relative to their web crawls, a ratio that worsened since early September 2025. Cloudflare, which services about 20% of the web, computes a crawl-to-refer metric indicating these firms extract content while sending limited traffic back, sometimes increasing costs for site owners.
Scoring Rationale
High relevance and credible Cloudflare data drive the score, tempered by limited novelty and mainly observational reporting.
Practice interview problems based on real data
1,500+ SQL & Python problems across 15 industry datasets — the exact type of data you work with.
Try 250 free problems
