Anthropic's Fable 5.2 Clears 41% of Real Upwork Projects
TL;DR
- Anthropic's Fable 5.2 completes 41.3% of real Upwork jobs on the Remote Labor Index, up from 2.5% for the top system a year ago.
- Anthropic's older Opus 5.5 scores 21.25%, OpenAI's GPT 6 Astra 20.83%, and Google's Gemini Argon 4 17.08%; GPT-5.2 and Gemini 3 Pro both come in under 3%.
- Scale Labs and CAIS built the index from 240 Upwork projects worth about $144,000, graded manually because AI reviewers couldn't operate the professional software.
Anthropic's Fable 5.2 completes 41.3 percent of real Upwork jobs at professional quality on the Remote Labor Index, a benchmark whose top system cleared only 2.5 percent a year ago, The Decoder reports. Scale Labs and the Center for AI Safety built the index from 240 completed projects by 358 verified Upwork professionals worth about $144,000; one job averages $632.60 and just under 29 hours of freelance time.
The gain is steep inside Anthropic's own lineup. Fable 5 scored 16 percent in July 2026, Fable 5.1 reached 17.9 percent, and Fable 5.2 now sits at 41.3 percent. Anthropic's older Opus 5.5 trails at 21.25 percent, ahead of OpenAI's GPT 6 Astra at 20.83 percent and Google's Gemini Argon 4 at 17.08 percent; GPT-5.2 and Gemini 3 Pro both score under 3 percent.
"Fable 5.2 makes its biggest gains in editing audio and music, designing architecture and interior spaces, and creating 3D models," the Scale Labs writeup says. It "can still barely handle other tasks, especially industrial product design and animations." Grading stays manual by design: "Trained human experts manually check whether an AI agent completed a job successfully," opening deliverables inside Blender, GIMP and Audacity to compare them against what the freelancer actually shipped. CAIS tried to automate review with another AI and it failed, because the AI reviewers could barely operate the professional software themselves and were fooled by submissions that looked polished but were technically flawed.
Originally reported by the-decoder.com
Read the original article →Original headline: Scale Labs Remote Labor Index: Claude Fable 5.2 Clears 41.3% of Real Upwork Projects, Double Opus 5.5