Skip to content
  1. Home
  2. Benchmarks
  3. Integration Bench
  4. GPT-5.6 Luna

GPT-5.6 Luna

Integration capability of coding agents on GPT-5.6 Luna.

Rank #20 of 21 Pass 1 51.78 ±5.58 Resolved 52% of tasks Harness Codex CLI Effort xhigh Total cost $7.11 Mean time 10 min Mean tool calls 38 Graded 50/50
54
polling
55% of tasks touching this surface resolved
57
writeback
57% of tasks touching this surface resolved
9
webhooks
9% of tasks touching this surface resolved

Published attempts

50 of 50 scored tasks released

One official run per task. Click a row for the full trajectory: every tool call, vendor request, graded check and the diff.

TaskTicketScoreChecksTool callsTimeCostOutcome
task-0001Sync StaffLine candidates, jobs, applications, and notes into our canonical store10030/3046 (6 failed)8 min$0.11resolved
task-0002Legal-hold export: TalentForge custodians and everything on file against them10064/6444 (5 failed)6 min$0.10resolved
task-0003Build the weekly Placemint contact sweep100343/34334 (3 failed)9 min$0.13resolved
task-0004Merge StaffLine application stage with Placemint placement stage048/6444 (4 failed)10 min$0.19mandatory fail
task-0005Keep TalentForge candidates fresh: webhooks + reconciliation polling018/2136 (1 failed)13 min$0.15mandatory fail
task-0006The case-note mirror is short every morning100160/16024 (3 failed)12 min$0.13resolved
task-0007Harden the Vettly sync connector for production scheduling9634/3821 (2 failed)10 min$0.12resolved
task-0008Build a StaffLine full-sync + writeback connector10033/3332 (7 failed)8 min$0.12resolved
task-0009Migrate off the legacy Bullpen app-token integration10040/4030 (3 failed)7 min$0.10resolved
task-0010Build the GlobalHire audit-period extract Compliance keeps asking us for10081/8142 (5 failed)8 min$0.13resolved
task-0011TalentForge connector: consume webhooks while pushing corrections upstream033/5166 (11 failed)17 min$0.23mandatory fail
task-0012Build the full TalentLoop connector: polling, webhooks, and writeback0112/12145 (9 failed)16 min$0.25mandatory fail
task-0013The warehouse and RecruitOS have been out of step for months013/9640 (2 failed)11 min$0.16partial
task-0014HireWire: clear the stale-screening correction backlog, exactly once10016/1627 (1 failed)10 min$0.14resolved
task-0015Bulk-import a migration batch into StaffLine022/2657 (6 failed)8 min$0.11mandatory fail
task-0016HireWire connector: push stage-change events + keep an incremental poll fresh9245/4836 (7 failed)10 min$0.13resolved
task-0017Move the Brightmoor candidate mirror onto TalentForge's event subscription023/15670 (12 failed)15 min$0.27partial
task-0018Rebuild the nightly requisition rollup on the RecruitOS API100142/14221 (1 failed)5 min$0.07resolved
task-0019Rebuild the Vettly change feed for the vaultd cutover100183/18420 (2 failed)6 min$0.09resolved
task-0020Sync GlobalHire candidates into our canonical store (offset polling)023/3443 (4 failed)10 min$0.16mandatory fail
task-0021Sync GlobalHire candidates, placements, and agencies into our canonical store015/2332 (3 failed)6 min$0.07mandatory fail
task-0022Harden the GlobalHire backfill for a production tenant10028/2882 (10 failed)21 min$0.24resolved
task-0023TalentLoop connector: keep a candidate/application mirror deletion-accurate018/2638 (3 failed)13 min$0.18mandatory fail
task-0024TalentLoop connector: unified freshness across webhook-covered and poll-only entities027/4042 (4 failed)16 min$0.20mandatory fail
task-0025Reset the CrewCall roster watermark after the tenant rebuild0500/50329 (1 failed)8 min$0.10partial
task-0026Push the Q1 close back into Placemint100269/26937 (3 failed)11 min$0.15resolved
task-0027Reliability: Interviewly connector loses and regresses updates017/2440 (17 failed)10 min$0.13mandatory fail
task-0028Harden the CrewCall snapshot connector for production012/4032 (3 failed)10 min$0.14mandatory fail
task-0029Get the Riverside signup file onto the CrewCall roster100102/10228 (2 failed)8 min$0.13resolved
task-0030Census the desk board against the Placemint placement book100325/32552 (6 failed)9 min$0.18resolved
task-0031Rebuild the morning bookable-crew board100101/10143 (4 failed)11 min$0.19resolved
task-0032Build the weekly capability index062/11826 (1 failed)5 min$0.07partial
task-0033Keep the RecruitOS pipeline and the Placemint ledger in step090/15538 (6 failed)11 min$0.15partial
task-0034Weekly crew top-up is putting people on the gate twice0164/16538 (4 failed)8 min$0.13partial
task-0035Sync Vettly subjects, checks, and reports into our canonical store10028/2835 (5 failed)9 min$0.13resolved
task-0036Harden the Placemint book extract for the larger tenant0212/42029 (5 failed)5 min$0.08partial
task-0037Fix the Placemint redeployment sync100306/30646 (14 failed)12 min$0.19resolved
task-0038TalentLoop connector: make webhook-driven freshness durable against a misbehaving receiver016/3785 (16 failed)11 min$0.15mandatory fail
task-0039Build the nightly payroll bridge for the punch export10094/9433 (3 failed)9 min$0.16resolved
task-0040Push interview reschedules upstream into Interviewly014/1741 (5 failed)14 min$0.22mandatory fail
task-0041Paygrade connector: employee/assignment sync and writeback031/3830 (3 failed)9 min$0.13mandatory fail
task-0042Move the rota mirror onto instant storage036/11734 (4 failed)8 min$0.12partial
task-0043The rota warehouse is counting the same night more than once10089/8915 (1 failed)5 min$0.06resolved
task-0044Nightly roster census disagrees with CrewCall about who works here10067/6728 (2 failed)4 min$0.07resolved
task-0045Replatform the ATS integration: StaffLine to Bullpen v210024/2436 (3 failed)7 min$0.10resolved
task-0046Get the scorecard export into TalentLoop084/8937 (2 failed)9 min$0.16partial
task-0047Reconcile and safely apply the mobility stage repair queue100100/10032 (5 failed)10 min$0.13resolved
task-0048Migrate the Brackett closure archive onto Paygrade087/21127 (1 failed)10 min$0.15partial
task-0049Placemint connector: webhooks, polling, and writeback for a high-volume tenant10061/6140 (2 failed)13 min$0.16resolved
task-0050Fix the Placemint fee-corrections connector100254/25433 (3 failed)10 min$0.14resolved