Skip to content
  1. Home
  2. Benchmarks
  3. Integration Bench
  4. GPT-5.6 Terra

GPT-5.6 Terra

Integration capability of coding agents on GPT-5.6 Terra.

Rank #18 of 21 Pass 1 53.79 ±5.33 Resolved 54% of tasks Harness Codex CLI Effort xhigh Total cost $47.10 Mean time 8 min Mean tool calls 22 Graded 50/50
57
polling
57% of tasks touching this surface resolved
66
writeback
67% of tasks touching this surface resolved
18
webhooks
18% of tasks touching this surface resolved

Published attempts

50 of 50 scored tasks released

One official run per task. Click a row for the full trajectory: every tool call, vendor request, graded check and the diff.

TaskTicketScoreChecksTool callsTimeCostOutcome
task-0001Sync StaffLine candidates, jobs, applications, and notes into our canonical store10030/3022 (2 failed)7 min$0.92resolved
task-0002Legal-hold export: TalentForge custodians and everything on file against them9762/6423 (2 failed)8 min$1.10resolved
task-0003Build the weekly Placemint contact sweep100343/34317 (2 failed)5 min$0.65resolved
task-0004Merge StaffLine application stage with Placemint placement stage048/6418 (2 failed)6 min$0.81mandatory fail
task-0005Keep TalentForge candidates fresh: webhooks + reconciliation polling018/2130 (2 failed)13 min$1.28mandatory fail
task-0006The case-note mirror is short every morning100159/15922 (5 failed)11 min$1.06resolved
task-0007Harden the Vettly sync connector for production scheduling10039/3931 (2 failed)11 min$1.43resolved
task-0008Build a StaffLine full-sync + writeback connector10033/3322 (2 failed)7 min$0.87resolved
task-0009Migrate off the legacy Bullpen app-token integration037/4013 (3 failed)6 min$0.67mandatory fail
task-0010Build the GlobalHire audit-period extract Compliance keeps asking us for10081/8113 (1 failed)6 min$0.63resolved
task-0011TalentForge connector: consume webhooks while pushing corrections upstream058/6441 (4 failed)13 min$1.87mandatory fail
task-0012Build the full TalentLoop connector: polling, webhooks, and writeback097/11925 (1 failed)13 min$1.30mandatory fail
task-0013The warehouse and RecruitOS have been out of step for months10096/9619 (1 failed)5 min$0.75resolved
task-0014HireWire: clear the stale-screening correction backlog, exactly once10016/1627 (3 failed)8 min$1.03resolved
task-0015Bulk-import a migration batch into StaffLine024/2615 (2 failed)5 min$0.58mandatory fail
task-0016HireWire connector: push stage-change events + keep an incremental poll fresh9245/4816 (2 failed)7 min$0.66resolved
task-0017Move the Brightmoor candidate mirror onto TalentForge's event subscription0143/16031 (3 failed)12 min$1.49partial
task-0018Rebuild the nightly requisition rollup on the RecruitOS API100142/14216 (1 failed)5 min$0.65resolved
task-0019Rebuild the Vettly change feed for the vaultd cutover100183/18418 (3 failed)9 min$1.11resolved
task-0020Sync GlobalHire candidates into our canonical store (offset polling)023/3417 (3 failed)8 min$0.68mandatory fail
task-0021Sync GlobalHire candidates, placements, and agencies into our canonical store10022/2218 (1 failed)8 min$0.76resolved
task-0022Harden the GlobalHire backfill for a production tenant10028/2871 (8 failed)25 min$2.07resolved
task-0023TalentLoop connector: keep a candidate/application mirror deletion-accurate015/2617 (1 failed)8 min$0.83mandatory fail
task-0024TalentLoop connector: unified freshness across webhook-covered and poll-only entities027/4017 (2 failed)10 min$0.90mandatory fail
task-0025Reset the CrewCall roster watermark after the tenant rebuild0500/50321 (3 failed)8 min$0.94partial
task-0026Push the Q1 close back into Placemint100269/26918 (2 failed)7 min$0.87resolved
task-0027Reliability: Interviewly connector loses and regresses updates017/2423 (1 failed)10 min$1.21mandatory fail
task-0028Harden the CrewCall snapshot connector for production012/4019 (1 failed)8 min$0.78mandatory fail
task-0029Get the Riverside signup file onto the CrewCall roster100102/10218 (2 failed)7 min$0.85resolved
task-0030Census the desk board against the Placemint placement book100324/32410 (1 failed)5 min$0.55resolved
task-0031Rebuild the morning bookable-crew board100101/10121 (1 failed)6 min$0.82resolved
task-0032Build the weekly capability index060/11820 (1 failed)6 min$0.91partial
task-0033Keep the RecruitOS pipeline and the Placemint ledger in step0115/15321 (1 failed)7 min$0.90partial
task-0034Weekly crew top-up is putting people on the gate twice100165/165146 min$0.76resolved
task-0035Sync Vettly subjects, checks, and reports into our canonical store10028/2833 (5 failed)8 min$1.14resolved
task-0036Harden the Placemint book extract for the larger tenant0212/42016 (2 failed)5 min$0.62partial
task-0037Fix the Placemint redeployment sync100307/30720 (2 failed)7 min$0.92resolved
task-0038TalentLoop connector: make webhook-driven freshness durable against a misbehaving receiver016/3715 (1 failed)8 min$0.76mandatory fail
task-0039Build the nightly payroll bridge for the punch export10094/9418 (2 failed)6 min$0.78resolved
task-0040Push interview reschedules upstream into Interviewly014/1727 (1 failed)11 min$1.33mandatory fail
task-0041Paygrade connector: employee/assignment sync and writeback028/3819 (2 failed)8 min$0.91mandatory fail
task-0042Move the rota mirror onto instant storage076/11727 (3 failed)8 min$1.05partial
task-0043The rota warehouse is counting the same night more than once083/8918 (2 failed)5 min$0.68partial
task-0044Nightly roster census disagrees with CrewCall about who works here10067/6726 (2 failed)4 min$0.43resolved
task-0045Replatform the ATS integration: StaffLine to Bullpen v2020/2424 (1 failed)9 min$1.15mandatory fail
task-0046Get the scorecard export into TalentLoop10089/8928 (2 failed)8 min$1.35resolved
task-0047Reconcile and safely apply the mobility stage repair queue100100/10017 (2 failed)6 min$0.72resolved
task-0048Migrate the Brackett closure archive onto Paygrade077/21122 (3 failed)6 min$0.95partial
task-0049Placemint connector: webhooks, polling, and writeback for a high-volume tenant10064/6419 (3 failed)12 min$1.04resolved
task-0050Fix the Placemint fee-corrections connector100253/253125 min$0.54resolved