Claude Fable 5.2 Matched a Professional on 41% of Freelance Projects: What the Number Measures
Anthropic's system card says the model it released on 9 November 2026 completed 99 of 240 freelance projects to the standard of a paid professional, about double the score of Claude Opus 5.5. The figure describes project deliverables in a test. It does not count jobs, and it does not say what employers have done.
Anthropic released Claude Fable 5.2 on 9 November 2026. One row in the benchmark table of its announcement concerns paid work directly: a score of 41.3% on the Remote Labor Index, against 21.3% for Claude Opus 5.5 and 17.9% for Fable 5.1, the version it replaces. The system card published the same day puts the result in a sentence, saying the model “completed 41.3% of freelance projects at least as well as a human professional.”
A sentence like that is easy to shorten in a planning meeting to “AI can do 41% of the work” or “41% of jobs.” Neither version matches what was tested. This piece explains what was measured and what was left out, then sets out how an HR or finance leader can put the result to use.
Key takeaways
- The Remote Labor Index is a set of 240 real freelance projects. The score is the share where human evaluators judged the AI deliverable at least as good as the one a paid professional produced (benchmark paper).
- The benchmark leaves out work that depends on clients or teams, so the score describes one kind of work, a deliverable produced alone from a written brief.
- The result is a test of capability at one point in time. It does not count jobs or measure what employers have adopted, and Anthropic’s system card offers no forecast from it.
- The practical use is to look at tasks role by role, starting with project work your company already buys from freelancers and agencies.
What is the Remote Labor Index?
The Remote Labor Index is a benchmark, meaning a fixed set of test items that different AI systems attempt so their results can be compared. Researchers at the Center for AI Safety and Scale AI built it and described it in a paper dated 30 October 2025. The test items are 240 projects completed by human professionals, most of them collected from professionals with verified Upwork accounts who sold the researchers samples of past work.
Each project has a written brief, the input files the freelancer worked from, and the deliverable the freelancer handed over. The paper’s examples include an animated advertisement for a tree services company and architectural plans for a container home. Video, computer-aided design, graphic design, game development and audio are the largest categories, at 10% to 13% each, and the set covers 23 of the 64 work categories Upwork uses.
The paper reports a median cost of $200 and a median completion time of 11.5 hours per project, as stated by the professionals who did the work. A few projects are far larger, with costs above $10,000 and completion times above 100 hours. Taken together, the authors put the set at more than 6,000 hours of professional time and $143,991 in fees.
How was “matched a professional” judged?
People did the judging. The AI agent receives the brief and the input files and produces its own deliverable. According to the paper, three trained evaluators then each compare that deliverable with the professional’s and decide whether it “would be accepted by a reasonable client as the commissioned work.” The majority view decides the outcome for that project. Each evaluator was given up to 20 minutes for a project and took 11.4 minutes on average, and the evaluators agreed with one another 94.4% of the time.
The headline figure is what the authors call the automation rate: the percentage of projects where the AI deliverable was judged to complete the project at least as well as the professional’s. For Fable 5.2 the system card gives this as 99 of 240 projects. It also says Scale AI ran the test at high effort with a 200,000-token context window, settings the card describes as defaults. Scale AI is one of the benchmark’s two creators, and the same 41.3% appears on its public leaderboard in an entry dated 9 November 2026. That makes this one of the results in the system card that an outside party produced.
What does the number leave out?
| The score does cover | The score does not cover |
|---|---|
| A finished deliverable produced from a written brief and files | Work that needs conversation with a client, such as tutoring |
| Freelance projects, median 11.5 hours of professional time | Work done as part of a team, such as project management |
| Design, video, audio, game, architecture and data projects | Physical work, back-end software development, and results that take time to judge, such as search optimization |
| Whether a reasonable client would accept the result | What the AI run cost, and which project types passed |
| Capability in a test in November 2026 | Whether any employer has moved this work to AI |
The unit is a project. A project is a different thing from a job. A job is a continuing set of tasks, done with colleagues, for clients and managers who change their minds. The paper’s authors say they organized the benchmark by Upwork’s categories because the federal O*NET occupation list was a weaker fit for freelance projects. They also state the limit plainly: a system that scored 100% could still underperform people on the kinds of work the benchmark does not test (paper, section 5).
Adoption is measured separately. A benchmark shows what a system produced under test conditions, and usage data shows what people do with it at work. Anthropic’s own labor market study from March 2026 uses a measure it calls observed exposure, which combines estimates of what the models can do with real usage of Claude. On that measure computer programmers ranked highest, with 75% of their tasks covered, and 30% of workers were in occupations with no measured coverage, which means too little usage to register and says nothing about future potential. The study found “no systematic increase in unemployment for highly exposed workers since late 2022.”
The result describes the past. When the benchmark launched in October 2025, the best agent scored 2.5% (paper). A little over a year later the best score is 41.3%. That is a large change, and it describes two measurements in the past. Anthropic’s announcement does not mention jobs or the labor market, and the system card draws no projection from the result.
The decimal overstates the precision. With 240 projects, each one moves the score by about 0.4 points. The leaderboard publishes no margin of error and states: “There is no confidence interval for Automation Rate.”
What Anthropic says about the model, and where its own results differ
Anthropic’s announcement does not position Fable 5.2 as the default choice for office work. It recommends that users start with Opus 5.5 for most coding and knowledge tasks and reserves Fable for “the most ambitious, open-ended technical work.” The model documentation lists Fable 5.2 at $8 per million input tokens and $40 per million output tokens, twice the Opus 5.5 rate.
Other benchmarks in the same system card do not all point the same way. On GDPval-AA v2.1, a test of 220 professional tasks across 44 occupations run by the firm Artificial Analysis, Fable 5.2 received an Elo rating of 1831 and trailed Opus 5.5 at 1866. An Elo rating ranks models against each other from head-to-head comparisons of their output, and a higher number is better. On an internal finance evaluation of 123 tasks, Fable 5.2 did not finish six within the three-hour limit, while Opus 5.5 finished all of them. On the question of replacing its own researchers, Anthropic writes that Mythos 5.2, which the announcement describes as the same underlying model, “does not seem close to fully substituting for our research staff,” and labels that assessment uncertain.
All of these figures come from a vendor’s document about its own product. According to the system card, the Remote Labor Index and GDPval-AA runs were carried out by outside organizations, and the finance evaluation was built and graded inside Anthropic.
How should an HR or finance leader read a result like this?
Read it by task first. The benchmark tests one shape of work: a deliverable that one person can produce alone from a written brief and a folder of files. For each role, separate the work of that shape from the work that is different, such as meetings, negotiation, supervision and decisions that depend on context nobody wrote down. The useful question is how much of the week goes to brief-and-deliverable work, and the answer for a motion designer is unlikely to match the answer for an account manager.
Then read it by role and by budget line. The projects in the test were bought on a freelance marketplace, so the nearest match inside a company is outsourced project work: the design, video, drafting and analysis jobs that go to freelancers and agencies. That spend is a more direct comparison than payroll. For employees, the result is a reason to review which tasks in a role may change. It is weak evidence for removing the role, a point our guide Before You Cut Headcount for AI covers in detail. JobRoute’s own task scores draw on observed AI use from the Anthropic Economic Index together with O*NET task data, and model benchmarks are not an input (methodology).
Include review time in the cost. A 41.3% pass rate (system card) means the other 58.7% of deliverables were judged short of the professional standard, and nobody knew which were which until trained people had checked every one. In the benchmark each project was checked by three evaluators who averaged 11.4 minutes apiece (paper). In a company, record who does that checking and how long it takes, because that time belongs in the business case alongside the model’s usage fees.
Test on your own work before changing a plan. Pick ten or twelve past briefs where you still hold the files and the deliverable you accepted. Have an AI agent attempt each one, and ask reviewers who do not know which version is which to apply the benchmark’s standard of whether a reasonable client would accept it. The result will be a small sample, and it will describe your work and your quality bar. Put a date on it, because the score on this benchmark rose from 17.9% to 41.3% between one version of the model and the next (system card).
For the wider evidence on exposure and employment, see AI and Jobs in 2026: What the Data Actually Says. If a task-level view of your own roles would help, JobRoute builds a free AI exposure sample for 10 roles, and you can request it here.
Sources and further reading
- Claude Fable 5.2 and Claude Mythos 5.2 (release announcement, 9 November 2026; benchmark table lists Remote Labor Index 41.3% against 17.9% for Fable 5.1 and 21.3% for Opus 5.5; recommends Opus 5.5 for most coding and knowledge tasks)
- Claude Fable 5.2 and Claude Mythos 5.2 System Card (section 8.14.7 Remote Labor Index: 99 of 240 projects, run by Scale AI at default settings; section 8.14.3 GDPval-AA v2.1; section 8.14.6 Real-World Finance v2; summary statement on research staff)
- Remote Labor Index: Measuring AI Automation of Remote Work, arXiv:2510.26787 (240 projects, 23 Upwork categories, evaluation method, 94.4% evaluator agreement, 2.5% top score at launch, stated limitations)
- Remote Labor Index leaderboard (Fable 5.2 at 41.3%, entry dated 9 November 2026; no confidence interval for automation rate; stated limitations)
- Remote Labor Index project site (over 6,000 hours of work valued at over $140,000)
- Claude Fable 5.2 model overview (list price $8 and $40 per million tokens; Opus 5.5 at $4 and $20)
- Labor market impacts of AI: A new measure and early evidence (computer programmers 75% task coverage; 30% of workers with zero coverage; no systematic increase in unemployment for highly exposed workers)
Frequently asked questions
What did Claude Fable 5.2 score on the Remote Labor Index?
Anthropic's system card for the model, published 9 November 2026, reports an automation rate of 41.3%, or 99 of 240 projects. The same table lists Claude Opus 5.5 at 21.3%, GPT-6 Astra at 20.8% and Claude Fable 5.1 at 17.9%. Scale AI, one of the two organizations that built the benchmark, ran the evaluation at the model's default settings, and the score appears on Scale's public leaderboard.
What is the Remote Labor Index?
It is a benchmark built by the Center for AI Safety and Scale AI and described in a paper published in October 2025. According to that paper, it contains 240 real freelance projects, most collected from professionals on Upwork, in fields such as video, computer-aided design, graphic design, game development, audio and architecture. Each project has a written brief, the input files, and the deliverable a paid professional produced. The projects took a median of 11.5 hours and cost a median of $200.
How does the Remote Labor Index decide that an AI matched a professional?
People judge it. According to the benchmark's paper, three trained evaluators each compare the AI deliverable with the professional's deliverable and decide whether a reasonable client would accept the AI version as the commissioned work. The majority view decides. The automation rate is the share of projects where the AI deliverable was judged at least as good as the professional's. The benchmark's authors report 94.4% agreement between evaluators.
Does a 41% score mean AI can do 41% of jobs?
No. The unit is a self-contained freelance project, and a job is an ongoing set of tasks carried out with colleagues and clients. The benchmark leaves out work that needs client interaction, teamwork, physical presence or a long wait to judge the result. Its authors write that even a 100% score could sit alongside weaker performance than humans on the kinds of work they did not test. The score also describes a test and says nothing about how much work employers have moved to AI.
Is the Remote Labor Index result a forecast of job losses?
No. It is a measurement taken at one point in time. The benchmark's paper reported a best score of 2.5% at launch in October 2025, and the best score on its leaderboard in November 2026 is 41.3%. Anthropic's announcement of the model does not mention jobs or the labor market, and its system card makes no projection from the result.
How should an HR or finance leader use a benchmark result like this?
Use it as a prompt to look at tasks. List the work in each role that resembles what the benchmark tests, which is a deliverable produced alone from a written brief. Check first where that work is bought from freelancers or agencies. Then test an AI agent on a small set of your own past briefs, have reviewers judge the results against the work you accepted, and include the cost of that review in any business case. Date the assessment, because scores are changing between model versions.