Skip to content
  1. Home
  2. Benchmarks
  3. Integration Bench
  4. GLM 5.3 Flash

GLM 5.3 Flash

Integration capability of coding agents on GLM 5.3 Flash.

Rank #9 of 20 Pass 1 59.37 ±5.63 Resolved 60% of tasks Harness OpenCode Effort max Total cost $5.47 Mean time 37 min Mean tool calls 83 Graded 50/50
68
polling
69% of tasks touching this surface resolved
61
writeback
62% of tasks touching this surface resolved
35
webhooks
36% of tasks touching this surface resolved

Published attempts

50 of 50 scored tasks released

One official run per task. Click a row for the full trajectory: every tool call, vendor request, graded check and the diff.

TaskTicketScoreChecksTool callsTimeCostOutcome
task-0001Sync StaffLine candidates, jobs, applications, and notes into our canonical store9232/3360 (1 failed)30 min$0.10resolved
task-0002Legal-hold export: TalentForge custodians and everything on file against them9762/6497 (10 failed)33 min$0.08resolved
task-0003Build the weekly Placemint contact sweep100343/3438140 min$0.11resolved
task-0004Merge StaffLine application stage with Placemint placement stage049/6576 (7 failed)36 min$0.09mandatory fail
task-0005Keep TalentForge candidates fresh: webhooks + reconciliation polling9424/27199 (12 failed)35 min$0.36resolved
task-0006The case-note mirror is short every morning100159/15993 (5 failed)55 min$0.13resolved
task-0007Harden the Vettly sync connector for production scheduling10039/39109 (6 failed)58 min$0.15resolved
task-0008Build a StaffLine full-sync + writeback connector10033/3389 (3 failed)44 min$0.12resolved
task-0009Migrate off the legacy Bullpen app-token integration10040/40132 (10 failed)42 min$0.15resolved
task-0010Build the GlobalHire audit-period extract Compliance keeps asking us for10081/8156 (2 failed)20 min$0.05resolved
task-0011TalentForge connector: consume webhooks while pushing corrections upstream041/52115 (4 failed)50 min$0.18mandatory fail
task-0012Build the full TalentLoop connector: polling, webhooks, and writeback94120/123125 (2 failed)63 min$0.21resolved timed out
task-0013The warehouse and RecruitOS have been out of step for months10096/9679 (5 failed)26 min$0.10resolved
task-0014HireWire: clear the stale-screening correction backlog, exactly once10016/1635 (1 failed)33 min$0.06resolved
task-0015Bulk-import a migration batch into StaffLine024/2674 (7 failed)29 min$0.10mandatory fail
task-0016HireWire connector: push stage-change events + keep an incremental poll fresh9245/4869 (1 failed)45 min$0.11resolved
task-0017Move the Brightmoor candidate mirror onto TalentForge's event subscription0111/16055 (2 failed)61 min$0.07partial timed out
task-0018Rebuild the nightly requisition rollup on the RecruitOS API100142/14261 (4 failed)17 min$0.04resolved
task-0019Rebuild the Vettly change feed for the vaultd cutover093/18420 (1 failed)8 min$0.01partial
task-0020Sync GlobalHire candidates into our canonical store (offset polling)10034/3489 (6 failed)14 min$0.07resolved
task-0021Sync GlobalHire candidates, placements, and agencies into our canonical store10021/2190 (4 failed)34 min$0.09resolved
task-0022Harden the GlobalHire backfill for a production tenant026/27100 (4 failed)65 min$0.12mandatory fail timed out
task-0023TalentLoop connector: keep a candidate/application mirror deletion-accurate018/2686 (2 failed)39 min$0.10mandatory fail
task-0024TalentLoop connector: unified freshness across webhook-covered and poll-only entities030/4060 (2 failed)35 min$0.08mandatory fail
task-0025Reset the CrewCall roster watermark after the tenant rebuild013/50317 (1 failed)8 min$0.01partial
task-0026Push the Q1 close back into Placemint0269/26962 (5 failed)24 min$0.06partial
task-0027Reliability: Interviewly connector loses and regresses updates021/286951 min$0.10mandatory fail
task-0028Harden the CrewCall snapshot connector for production10044/44129 (4 failed)60 min$0.17resolved timed out
task-0029Get the Riverside signup file onto the CrewCall roster100102/10279 (1 failed)31 min$0.13resolved
task-0030Census the desk board against the Placemint placement book100325/32558 (3 failed)22 min$0.08resolved
task-0031Rebuild the morning bookable-crew board100101/10160 (4 failed)36 min$0.10resolved
task-0032Build the weekly capability index100116/1186924 min$0.07resolved
task-0033Keep the RecruitOS pipeline and the Placemint ledger in step0115/15379 (4 failed)37 min$0.11partial
task-0034Weekly crew top-up is putting people on the gate twice100165/16590 (8 failed)60 min$0.17resolved timed out
task-0035Sync Vettly subjects, checks, and reports into our canonical store10028/28102 (3 failed)41 min$0.09resolved
task-0036Harden the Placemint book extract for the larger tenant0212/4206718 min$0.07partial
task-0037Fix the Placemint redeployment sync100306/30689 (1 failed)43 min$0.15resolved
task-0038TalentLoop connector: make webhook-driven freshness durable against a misbehaving receiver021/37126 (5 failed)24 min$0.18mandatory fail
task-0039Build the nightly payroll bridge for the punch export10093/9383 (11 failed)24 min$0.12resolved
task-0040Push interview reschedules upstream into Interviewly014/1779 (8 failed)48 min$0.09mandatory fail
task-0041Paygrade connector: employee/assignment sync and writeback028/3887 (3 failed)46 min$0.10mandatory fail
task-0042Move the rota mirror onto instant storage100117/11767 (2 failed)21 min$0.06resolved
task-0043The rota warehouse is counting the same night more than once083/896635 min$0.05partial
task-0044Nightly roster census disagrees with CrewCall about who works here10067/6778 (3 failed)31 min$0.10resolved
task-0045Replatform the ATS integration: StaffLine to Bullpen v2021/2583 (4 failed)27 min$0.12mandatory fail
task-0046Get the scorecard export into TalentLoop083/8871 (9 failed)45 min$0.11partial
task-0047Reconcile and safely apply the mobility stage repair queue100100/10099 (1 failed)35 min$0.15resolved
task-0048Migrate the Brackett closure archive onto Paygrade0128/21178 (6 failed)26 min$0.14partial
task-0049Placemint connector: webhooks, polling, and writeback for a high-volume tenant10068/68139 (3 failed)92 min$0.21resolved
task-0050Fix the Placemint fee-corrections connector100254/25471 (10 failed)13 min$0.07resolved