Skip to content
  1. Home
  2. Benchmarks
  3. Integration Bench
  4. Claude Fable 5

Claude Fable 5

Integration capability of coding agents on Claude Fable 5.

Rank #2 of 21 Pass 1 67.68 ±4.72 Resolved 68% of tasks Harness Claude Code Effort xhigh Total cost $333.42 Mean time 12 min Mean tool calls 44 Graded 50/50
76
polling
76% of tasks touching this surface resolved
71
writeback
71% of tasks touching this surface resolved
36
webhooks
36% of tasks touching this surface resolved

Published attempts

50 of 50 scored tasks released

One official run per task. Click a row for the full trajectory: every tool call, vendor request, graded check and the diff.

TaskTicketScoreChecksTool callsTimeCostOutcome
task-0001Sync StaffLine candidates, jobs, applications, and notes into our canonical store10030/304210 min$5.72resolved
task-0002Legal-hold export: TalentForge custodians and everything on file against them10064/644110 min$5.24resolved
task-0003Build the weekly Placemint contact sweep100343/34334 (3 failed)10 min$5.89resolved
task-0004Merge StaffLine application stage with Placemint placement stage049/6584 (4 failed)23 min$13.57mandatory fail
task-0005Keep TalentForge candidates fresh: webhooks + reconciliation polling018/2163 (1 failed)18 min$10.15mandatory fail
task-0006The case-note mirror is short every morning100159/15940 (1 failed)14 min$5.67resolved
task-0007Harden the Vettly sync connector for production scheduling10039/3949 (4 failed)18 min$8.48resolved
task-0008Build a StaffLine full-sync + writeback connector032/3355 (3 failed)19 min$10.33mandatory fail
task-0009Migrate off the legacy Bullpen app-token integration037/40428 min$4.08mandatory fail
task-0010Build the GlobalHire audit-period extract Compliance keeps asking us for10081/8141 (1 failed)7 min$4.47resolved
task-0011TalentForge connector: consume webhooks while pushing corrections upstream042/5254 (4 failed)24 min$12.03mandatory fail
task-0012Build the full TalentLoop connector: polling, webhooks, and writeback91120/12364 (1 failed)22 min$11.57resolved
task-0013The warehouse and RecruitOS have been out of step for months10096/9637 (2 failed)7 min$4.28resolved
task-0014HireWire: clear the stale-screening correction backlog, exactly once10016/1641 (1 failed)13 min$6.62resolved
task-0015Bulk-import a migration batch into StaffLine023/2640 (3 failed)10 min$5.47mandatory fail
task-0016HireWire connector: push stage-change events + keep an incremental poll fresh9245/4835 (5 failed)11 min$6.11resolved
task-0017Move the Brightmoor candidate mirror onto TalentForge's event subscription100160/16063 (3 failed)18 min$9.98resolved
task-0018Rebuild the nightly requisition rollup on the RecruitOS API100142/14237 (3 failed)8 min$4.09resolved
task-0019Rebuild the Vettly change feed for the vaultd cutover100183/18435 (2 failed)10 min$5.16resolved
task-0020Sync GlobalHire candidates into our canonical store (offset polling)10034/3437 (3 failed)9 min$4.46resolved
task-0021Sync GlobalHire candidates, placements, and agencies into our canonical store10022/2255 (5 failed)11 min$7.07resolved
task-0022Harden the GlobalHire backfill for a production tenant10028/2842 (3 failed)25 min$6.53resolved
task-0023TalentLoop connector: keep a candidate/application mirror deletion-accurate018/2638 (7 failed)11 min$5.80mandatory fail
task-0024TalentLoop connector: unified freshness across webhook-covered and poll-only entities028/4055 (4 failed)18 min$10.08mandatory fail
task-0025Reset the CrewCall roster watermark after the tenant rebuild0500/503377 min$3.70partial
task-0026Push the Q1 close back into Placemint100269/26928 (3 failed)9 min$4.69resolved
task-0027Reliability: Interviewly connector loses and regresses updates017/2443 (2 failed)12 min$6.16mandatory fail
task-0028Harden the CrewCall snapshot connector for production10044/44338 min$4.33resolved
task-0029Get the Riverside signup file onto the CrewCall roster100102/102399 min$5.25resolved
task-0030Census the desk board against the Placemint placement book100325/32538 (1 failed)9 min$4.62resolved
task-0031Rebuild the morning bookable-crew board100101/10138 (3 failed)7 min$4.77resolved
task-0032Build the weekly capability index100116/11838 (3 failed)7 min$6.30resolved
task-0033Keep the RecruitOS pipeline and the Placemint ledger in step100153/15332 (1 failed)14 min$7.52resolved
task-0034Weekly crew top-up is putting people on the gate twice100165/1653711 min$6.15resolved
task-0035Sync Vettly subjects, checks, and reports into our canonical store10028/2836 (1 failed)13 min$5.25resolved
task-0036Harden the Placemint book extract for the larger tenant100420/42037 (1 failed)7 min$3.99resolved
task-0037Fix the Placemint redeployment sync100306/30638 (5 failed)12 min$6.34resolved
task-0038TalentLoop connector: make webhook-driven freshness durable against a misbehaving receiver019/374414 min$7.11mandatory fail
task-0039Build the nightly payroll bridge for the punch export10093/9345 (2 failed)10 min$6.77resolved
task-0040Push interview reschedules upstream into Interviewly017/2054 (5 failed)14 min$9.32mandatory fail
task-0041Paygrade connector: employee/assignment sync and writeback029/3856 (1 failed)15 min$8.98mandatory fail
task-0042Move the rota mirror onto instant storage100117/11743 (3 failed)8 min$4.97resolved
task-0043The rota warehouse is counting the same night more than once083/8934 (3 failed)7 min$3.76partial
task-0044Nightly roster census disagrees with CrewCall about who works here10067/6732 (1 failed)5 min$2.75resolved
task-0045Replatform the ATS integration: StaffLine to Bullpen v2020/2463 (7 failed)17 min$9.83mandatory fail
task-0046Get the scorecard export into TalentLoop083/8838 (2 failed)12 min$6.46partial
task-0047Reconcile and safely apply the mobility stage repair queue100100/1004210 min$5.39resolved
task-0048Migrate the Brackett closure archive onto Paygrade100211/21133 (3 failed)9 min$5.50resolved
task-0049Placemint connector: webhooks, polling, and writeback for a high-volume tenant10057/6986 (7 failed)34 min$17.39resolved
task-0050Fix the Placemint fee-corrections connector100254/254267 min$3.26resolved