Researchgenerative airemote workscale aimodel evaluation
AI Fails To Complete Remote Freelance Tasks
|
7.3
The Remote Labor Study, conducted by Scale AI and the Center for AI Safety, found that leading AI systems completed only a small fraction of remote freelance assignments in recent tests. Manus, the top-performing model, finished just 2.5% of tasks while systems produced poor-quality work on nearly half of projects and left over a third incomplete. The study suggests AI remains cheaper but substantially less reliable than human freelancers for many task types.
Scoring Rationale
Credible empirical study drives practical insight, but results focus narrowly on remote freelance task types.
Practice interview problems based on real data
1,500+ SQL & Python problems across 15 industry datasets — the exact type of data you work with.
Try 250 free problems
