Skip to content
  1. Home
  2. Benchmarks
  3. Integration Bench
  4. Muse Spark 1.3

Muse Spark 1.3

Integration capability of coding agents on Muse Spark 1.3.

Rank #12 of 20 Pass 1 57.66 ±5.22 Resolved 58% of tasks Harness OpenCode Effort high Total cost $70.11 Mean time 23 min Mean tool calls 74 Graded 50/50
61
polling
62% of tasks touching this surface resolved
66
writeback
67% of tasks touching this surface resolved
18
webhooks
18% of tasks touching this surface resolved

Published attempts

50 of 50 scored tasks released

One official run per task. Click a row for the full trajectory: every tool call, vendor request, graded check and the diff.

TaskTicketScoreChecksTool callsTimeCostOutcome
task-0001Sync StaffLine candidates, jobs, applications, and notes into our canonical store9229/308113 min$1.02resolved
task-0002Legal-hold export: TalentForge custodians and everything on file against them10064/6477 (3 failed)21 min$1.38resolved
task-0003Build the weekly Placemint contact sweep100343/34344 (2 failed)7 min$0.41resolved
task-0004Merge StaffLine application stage with Placemint placement stage048/6480 (2 failed)13 min$0.94mandatory fail
task-0005Keep TalentForge candidates fresh: webhooks + reconciliation polling024/28104 (7 failed)49 min$2.42mandatory fail
task-0006The case-note mirror is short every morning100159/15963 (3 failed)29 min$0.81resolved
task-0007Harden the Vettly sync connector for production scheduling10039/3986 (4 failed)36 min$1.45resolved
task-0008Build a StaffLine full-sync + writeback connector10033/3381 (3 failed)12 min$0.81resolved
task-0009Migrate off the legacy Bullpen app-token integration038/40113 (2 failed)27 min$2.91mandatory fail
task-0010Build the GlobalHire audit-period extract Compliance keeps asking us for10081/8164 (11 failed)6 min$0.59resolved
task-0011TalentForge connector: consume webhooks while pushing corrections upstream056/60104 (4 failed)56 min$2.57mandatory fail
task-0012Build the full TalentLoop connector: polling, webhooks, and writeback94120/12380 (4 failed)33 min$1.45resolved
task-0013The warehouse and RecruitOS have been out of step for months093/9679 (1 failed)33 min$1.68partial
task-0014HireWire: clear the stale-screening correction backlog, exactly once10016/16134 (2 failed)56 min$2.59resolved
task-0015Bulk-import a migration batch into StaffLine024/2651 (2 failed)23 min$0.99mandatory fail
task-0016HireWire connector: push stage-change events + keep an incremental poll fresh9847/48106 (1 failed)19 min$1.38resolved
task-0017Move the Brightmoor candidate mirror onto TalentForge's event subscription0144/1607423 min$1.26partial
task-0018Rebuild the nightly requisition rollup on the RecruitOS API0141/14256 (4 failed)12 min$0.78partial
task-0019Rebuild the Vettly change feed for the vaultd cutover100183/18451 (1 failed)12 min$0.73resolved
task-0020Sync GlobalHire candidates into our canonical store (offset polling)10034/3458 (3 failed)10 min$0.60resolved
task-0021Sync GlobalHire candidates, placements, and agencies into our canonical store10022/2270 (3 failed)15 min$2.52resolved
task-0022Harden the GlobalHire backfill for a production tenant026/2774 (1 failed)52 min$2.47mandatory fail
task-0023TalentLoop connector: keep a candidate/application mirror deletion-accurate018/2663 (6 failed)43 min$2.28mandatory fail
task-0024TalentLoop connector: unified freshness across webhook-covered and poll-only entities030/4080 (3 failed)39 min$1.43mandatory fail
task-0025Reset the CrewCall roster watermark after the tenant rebuild0500/50369 (3 failed)20 min$1.21partial
task-0026Push the Q1 close back into Placemint0268/26854 (2 failed)17 min$0.65partial
task-0027Reliability: Interviewly connector loses and regresses updates07/2443 (1 failed)19 min$0.96mandatory fail
task-0028Harden the CrewCall snapshot connector for production10044/4487 (1 failed)22 min$1.14resolved
task-0029Get the Riverside signup file onto the CrewCall roster100102/10266 (3 failed)7 min$0.66resolved
task-0030Census the desk board against the Placemint placement book100324/32462 (7 failed)28 min$1.88resolved
task-0031Rebuild the morning bookable-crew board100101/10164 (1 failed)15 min$0.75resolved
task-0032Build the weekly capability index100116/11861 (2 failed)16 min$1.61resolved
task-0033Keep the RecruitOS pipeline and the Placemint ledger in step0123/15397 (4 failed)20 min$1.35partial
task-0034Weekly crew top-up is putting people on the gate twice100165/16590 (4 failed)16 min$1.31resolved
task-0035Sync Vettly subjects, checks, and reports into our canonical store10028/2871 (2 failed)17 min$1.10resolved
task-0036Harden the Placemint book extract for the larger tenant100420/42063 (3 failed)7 min$0.60resolved
task-0037Fix the Placemint redeployment sync100307/30792 (6 failed)60 min$5.27resolved
task-0038TalentLoop connector: make webhook-driven freshness durable against a misbehaving receiver018/374715 min$0.69mandatory fail
task-0039Build the nightly payroll bridge for the punch export10093/9373 (4 failed)19 min$1.43resolved
task-0040Push interview reschedules upstream into Interviewly014/1788 (1 failed)28 min$1.26mandatory fail
task-0041Paygrade connector: employee/assignment sync and writeback032/3871 (1 failed)19 min$1.08mandatory fail
task-0042Move the rota mirror onto instant storage100117/11743 (2 failed)12 min$0.59resolved
task-0043The rota warehouse is counting the same night more than once083/8969 (5 failed)12 min$0.85partial
task-0044Nightly roster census disagrees with CrewCall about who works here10067/6764 (2 failed)21 min$1.29resolved
task-0045Replatform the ATS integration: StaffLine to Bullpen v2020/2495 (4 failed)16 min$1.81mandatory fail
task-0046Get the scorecard export into TalentLoop10089/8969 (3 failed)12 min$0.74resolved
task-0047Reconcile and safely apply the mobility stage repair queue089/10088 (1 failed)23 min$1.34partial
task-0048Migrate the Brackett closure archive onto Paygrade100211/21160 (3 failed)14 min$1.04resolved
task-0049Placemint connector: webhooks, polling, and writeback for a high-volume tenant10064/6474 (1 failed)31 min$1.23resolved
task-0050Fix the Placemint fee-corrections connector100254/25460 (5 failed)47 min$2.81resolved