Skip to content
  1. Home
  2. Benchmarks
  3. Integration Bench
  4. Claude Fable 5.1

Claude Fable 5.1

Integration capability of coding agents on Claude Fable 5.1.

Rank #1 of 17 Pass 1 69.35 ±1.88 Resolved 70% of tasks Harness Claude Code Effort xhigh Total cost $322.99 Mean time 17 min Mean tool calls 31 Graded 50/50
76
polling
76% of tasks touching this surface resolved
71
writeback
71% of tasks touching this surface resolved
44
webhooks
45% of tasks touching this surface resolved

Published attempts

50 of 50 scored tasks released

One official run per task. Click a row for the full trajectory: every tool call, vendor request, graded check and the diff.

TaskTicketScoreChecksTool callsTimeCostOutcome
task-0001Sync StaffLine candidates, jobs, applications, and notes into our canonical store10030/3034 (5 failed)12 min$4.84resolved
task-0002Legal-hold export: TalentForge custodians and everything on file against them10064/6436 (1 failed)17 min$6.80resolved
task-0003Build the weekly Placemint contact sweep100343/34322 (1 failed)15 min$5.37resolved
task-0004Merge StaffLine application stage with Placemint placement stage033/654120 min$8.13mandatory fail
task-0005Keep TalentForge candidates fresh: webhooks + reconciliation polling9424/2725 (5 failed)19 minresolved
task-0006The case-note mirror is short every morning100159/15935 (3 failed)17 min$5.33resolved
task-0007Harden the Vettly sync connector for production scheduling10039/3921 (1 failed)24 min$9.68resolved
task-0008Build a StaffLine full-sync + writeback connector032/333218 min$7.40mandatory fail
task-0009Migrate off the legacy Bullpen app-token integration037/4039 (2 failed)16 min$6.69mandatory fail
task-0010Build the GlobalHire audit-period extract Compliance keeps asking us for10081/8123 (2 failed)14 min$5.76resolved
task-0011TalentForge connector: consume webhooks while pushing corrections upstream055/5963 (4 failed)22 min$9.14mandatory fail
task-0012Build the full TalentLoop connector: polling, webhooks, and writeback89119/12340 (1 failed)23 min$8.31resolved
task-0013The warehouse and RecruitOS have been out of step for months10096/9634 (1 failed)13 min$5.74resolved
task-0014HireWire: clear the stale-screening correction backlog, exactly once10016/1620 (1 failed)18 min$6.99resolved
task-0015Bulk-import a migration batch into StaffLine024/2627 (3 failed)15 min$6.12mandatory fail
task-0016HireWire connector: push stage-change events + keep an incremental poll fresh9245/4844 (1 failed)21 min$7.30resolved
task-0017Move the Brightmoor candidate mirror onto TalentForge's event subscription100160/16036 (3 failed)19 min$8.39resolved
task-0018Rebuild the nightly requisition rollup on the RecruitOS API100142/14224 (3 failed)11 min$4.61resolved
task-0019Rebuild the Vettly change feed for the vaultd cutover100184/18421 (1 failed)13 min$5.27resolved
task-0020Sync GlobalHire candidates into our canonical store (offset polling)10034/3430 (2 failed)10 min$4.43resolved
task-0021Sync GlobalHire candidates, placements, and agencies into our canonical store10023/234813 min$5.63resolved
task-0022Harden the GlobalHire backfill for a production tenant10027/274427 min$7.77resolved
task-0023TalentLoop connector: keep a candidate/application mirror deletion-accurate018/262614 min$5.19mandatory fail
task-0024TalentLoop connector: unified freshness across webhook-covered and poll-only entities028/4040 (2 failed)23 min$8.15mandatory fail
task-0025Reset the CrewCall roster watermark after the tenant rebuild0500/50324 (2 failed)13 min$5.06partial
task-0026Push the Q1 close back into Placemint100269/2692218 min$6.87resolved
task-0027Reliability: Interviewly connector loses and regresses updates017/2429 (1 failed)20 min$7.57mandatory fail
task-0028Harden the CrewCall snapshot connector for production10044/442815 min$5.94resolved
task-0029Get the Riverside signup file onto the CrewCall roster100102/1022815 min$4.58resolved
task-0030Census the desk board against the Placemint placement book100324/32430 (3 failed)10 min$4.46resolved
task-0031Rebuild the morning bookable-crew board100101/10135 (1 failed)14 min$6.29resolved
task-0032Build the weekly capability index100116/11831 (1 failed)13 min$5.43resolved
task-0033Keep the RecruitOS pipeline and the Placemint ledger in step100153/15337 (3 failed)17 min$7.44resolved
task-0034Weekly crew top-up is putting people on the gate twice100165/16519 (2 failed)14 min$5.90resolved
task-0035Sync Vettly subjects, checks, and reports into our canonical store022/2637 (3 failed)17 min$6.74mandatory fail
task-0036Harden the Placemint book extract for the larger tenant0212/42019 (1 failed)11 min$4.66partial
task-0037Fix the Placemint redeployment sync100307/30726 (5 failed)19 min$7.16resolved
task-0038TalentLoop connector: make webhook-driven freshness durable against a misbehaving receiver016/3735 (3 failed)21 min$8.12mandatory fail
task-0039Build the nightly payroll bridge for the punch export10093/9338 (4 failed)18 min$7.64resolved
task-0040Push interview reschedules upstream into Interviewly014/1738 (3 failed)18 min$7.05mandatory fail
task-0041Paygrade connector: employee/assignment sync and writeback030/3830 (2 failed)18 min$7.51mandatory fail
task-0042Move the rota mirror onto instant storage100117/1171911 min$4.70resolved
task-0043The rota warehouse is counting the same night more than once10089/8928 (2 failed)13 min$5.44resolved
task-0044Nightly roster census disagrees with CrewCall about who works here10067/6720 (1 failed)12 min$5.28resolved
task-0045Replatform the ATS integration: StaffLine to Bullpen v29223/2434 (2 failed)17 min$7.23resolved
task-0046Get the scorecard export into TalentLoop083/8825 (1 failed)16 min$6.86partial
task-0047Reconcile and safely apply the mobility stage repair queue100100/10031 (2 failed)12 min$5.46resolved
task-0048Migrate the Brackett closure archive onto Paygrade100211/2112813 min$5.64resolved
task-0049Placemint connector: webhooks, polling, and writeback for a high-volume tenant10068/6846 (5 failed)42 min$14.05resolved
task-0050Fix the Placemint fee-corrections connector100254/25417 (1 failed)18 min$6.86resolved