Skip to content
  1. Home
  2. Benchmarks
  3. Integration Bench
  4. GLM 5.3

GLM 5.3

Integration capability of coding agents on GLM 5.3.

Rank #14 of 20 Pass 1 57.31 ±5.41 Resolved 58% of tasks Harness OpenCode Effort max Total cost $56.67 Mean time 19 min Mean tool calls 76 Graded 50/50
62
polling
62% of tasks touching this surface resolved
61
writeback
62% of tasks touching this surface resolved
26
webhooks
27% of tasks touching this surface resolved

Published attempts

50 of 50 scored tasks released

One official run per task. Click a row for the full trajectory: every tool call, vendor request, graded check and the diff.

TaskTicketScoreChecksTool callsTimeCostOutcome
task-0001Sync StaffLine candidates, jobs, applications, and notes into our canonical store00/1137 (1 failed)9 min$0.40mandatory fail
task-0002Legal-hold export: TalentForge custodians and everything on file against them10064/6467 (6 failed)15 min$0.77resolved
task-0003Build the weekly Placemint contact sweep100343/34362 (3 failed)8 min$0.58resolved
task-0004Merge StaffLine application stage with Placemint placement stage7750/65150 (7 failed)21 min$2.07resolved
task-0005Keep TalentForge candidates fresh: webhooks + reconciliation polling03/1727 (2 failed)15 min$0.43mandatory fail
task-0006The case-note mirror is short every morning100159/15995 (2 failed)17 min$0.76resolved
task-0007Harden the Vettly sync connector for production scheduling014/3828 (9 failed)19 min$0.47mandatory fail
task-0008Build a StaffLine full-sync + writeback connector032/3378 (4 failed)20 min$1.04mandatory fail
task-0009Migrate off the legacy Bullpen app-token integration037/4081 (8 failed)20 min$1.10mandatory fail
task-0010Build the GlobalHire audit-period extract Compliance keeps asking us for10081/8171 (7 failed)7 min$0.90resolved
task-0011TalentForge connector: consume webhooks while pushing corrections upstream056/6074 (5 failed)15 min$1.10mandatory fail
task-0012Build the full TalentLoop connector: polling, webhooks, and writeback91120/12399 (1 failed)17 min$1.14resolved
task-0013The warehouse and RecruitOS have been out of step for months10096/9690 (3 failed)30 min$1.86resolved
task-0014HireWire: clear the stale-screening correction backlog, exactly once10016/16106 (2 failed)16 min$1.30resolved
task-0015Bulk-import a migration batch into StaffLine023/2676 (2 failed)14 min$0.99mandatory fail
task-0016HireWire connector: push stage-change events + keep an incremental poll fresh9847/4885 (3 failed)27 min$2.06resolved
task-0017Move the Brightmoor candidate mirror onto TalentForge's event subscription0111/16094 (4 failed)23 min$1.43partial
task-0018Rebuild the nightly requisition rollup on the RecruitOS API100142/14234 (1 failed)3 min$0.19resolved
task-0019Rebuild the Vettly change feed for the vaultd cutover100184/18492 (7 failed)20 min$2.22resolved
task-0020Sync GlobalHire candidates into our canonical store (offset polling)10034/3492 (4 failed)21 min$0.74resolved
task-0021Sync GlobalHire candidates, placements, and agencies into our canonical store10021/21109 (8 failed)22 min$1.39resolved
task-0022Harden the GlobalHire backfill for a production tenant025/27118 (5 failed)51 min$1.21mandatory fail
task-0023TalentLoop connector: keep a candidate/application mirror deletion-accurate018/26107 (3 failed)13 min$1.12mandatory fail
task-0024TalentLoop connector: unified freshness across webhook-covered and poll-only entities027/4066 (6 failed)13 min$0.94mandatory fail
task-0025Reset the CrewCall roster watermark after the tenant rebuild013/5033014 min$0.36partial
task-0026Push the Q1 close back into Placemint0269/26946 (3 failed)11 min$0.47partial
task-0027Reliability: Interviewly connector loses and regresses updates07/2443 (3 failed)61 min$0.32mandatory fail timed out
task-0028Harden the CrewCall snapshot connector for production10044/4489 (8 failed)16 min$1.25resolved
task-0029Get the Riverside signup file onto the CrewCall roster100102/10259 (6 failed)7 min$0.64resolved
task-0030Census the desk board against the Placemint placement book100325/32574 (2 failed)11 min$0.81resolved
task-0031Rebuild the morning bookable-crew board100101/10185 (2 failed)14 min$1.58resolved
task-0032Build the weekly capability index100116/11886 (2 failed)45 min$1.12resolved
task-0033Keep the RecruitOS pipeline and the Placemint ledger in step100153/15363 (7 failed)12 min$0.92resolved
task-0034Weekly crew top-up is putting people on the gate twice0164/16574 (4 failed)22 min$1.36partial
task-0035Sync Vettly subjects, checks, and reports into our canonical store10028/2854 (5 failed)54 min$3.36resolved
task-0036Harden the Placemint book extract for the larger tenant0212/42053 (2 failed)6 min$0.49partial
task-0037Fix the Placemint redeployment sync100306/30699 (2 failed)25 min$1.67resolved
task-0038TalentLoop connector: make webhook-driven freshness durable against a misbehaving receiver018/3745 (5 failed)10 min$0.57mandatory fail
task-0039Build the nightly payroll bridge for the punch export10093/93134 (9 failed)11 min$1.84resolved
task-0040Push interview reschedules upstream into Interviewly012/1680 (3 failed)25 min$0.93mandatory fail
task-0041Paygrade connector: employee/assignment sync and writeback00/643 (1 failed)21 min$0.34partial
task-0042Move the rota mirror onto instant storage100117/11766 (2 failed)8 min$0.56resolved
task-0043The rota warehouse is counting the same night more than once10089/8970 (3 failed)26 min$2.21resolved
task-0044Nightly roster census disagrees with CrewCall about who works here10067/6772 (2 failed)21 min$0.69resolved
task-0045Replatform the ATS integration: StaffLine to Bullpen v2020/2496 (4 failed)29 min$3.59mandatory fail
task-0046Get the scorecard export into TalentLoop083/8857 (2 failed)7 min$0.50partial
task-0047Reconcile and safely apply the mobility stage repair queue100100/10096 (2 failed)18 min$1.33resolved
task-0048Migrate the Brackett closure archive onto Paygrade100211/21180 (2 failed)28 min$0.92resolved
task-0049Placemint connector: webhooks, polling, and writeback for a high-volume tenant10068/68103 (3 failed)20 min$1.74resolved
task-0050Fix the Placemint fee-corrections connector100254/25468 (6 failed)14 min$0.90resolved