Industry Newsllmdata labelingmercorlabor market

Workers Train AI Using Expert-Labeled Data

||By LDS Team
7.2
Relevance Score
Workers Train AI Using Expert-Labeled Data
Photo: The Verge · rights & takedowns

Contractors, including displaced professionals like 'Katya,' are being hired by data firms such as Mercor (founded 2023), Scale AI, and Surge AI to produce and label training data for chatbots. Tasks include writing prompts, drafting ideal responses, and authoring rubrics; Mercor reports about 30,000 weekly workers and Scale cites over 700,000 contributors. The work pays well but is precarious, revealing a fragmented labor market powering current AI systems.

Key Points

  • 1Companies recruit tens of thousands of professionals to produce and label AI training data.
  • 2Create exhaustive rubrics and graded examples to convert subjective tasks into measurable training signals improving model performance.
  • 3Signal growing gig economy where educated workers perform precarious, well‑paid labeling roles, altering career and policy priorities.

Scoring Rationale

Documents sizable labor shift supplying LLM training data, but leans on anecdotal accounts and company-reported figures.

Practice with real Logistics & Shipping data

90 SQL & Python problems · 15 industry datasets

250 free problems · No credit card

See all Logistics & Shipping problems