Anthropic Finds AI Coding Assistance Hurts Comprehension
Anthropic published a randomized controlled trial in 2024 finding developers using AI coding assistance scored 17% lower on comprehension quizzes than those coding manually, with productivity gains failing to reach statistical significance. The 52 mostly junior engineers learned the Trio asynchronous library; patterns of AI use determined outcomes, with conceptual-question usage linked to 65%+ scores while full code delegation yielded under 40%, and a University of Maribor study found similar correlations.
Scoring Rationale
Strong experimental evidence and practical guidance, but small sample size and short-term measurement limit generalizability.
Practice interview problems based on real data
1,500+ SQL & Python problems across 15 industry datasets — the exact type of data you work with.
Try 250 free problemsStep-by-step roadmaps from zero to job-ready — curated courses, salary data, and the exact learning order that gets you hired.
Sources
- Read OriginalAnthropic Study: AI Coding Assistance Reduces Developer Skill Mastery by 17%infoq.com
