DeepSeek V4 Flash (max)

Rank #9 of 17 Task score 55.68 Resolved 56% of tasks Harness OpenCode Effort max Total cost $4.37 Mean time 24 min Mean tool calls 82

polling

62% of tasks touching this surface resolved

writeback

57% of tasks touching this surface resolved

webhooks

18% of tasks touching this surface resolved

Published attempts

10 of 50 scored tasks released

One official run per task. Click a row for the full trajectory: every tool call, vendor request, graded check and the diff.

Task	Ticket	Score	Checks	Tool calls	Time	Cost	Outcome
task-0001	Sync StaffLine candidates, jobs, applications, and notes into our canonical store	92	29/30	93 (3 failed)	26 min	$0.08	resolved
task-0011	TalentForge connector: consume webhooks while pushing corrections upstream	0	33/51	149 (7 failed)	52 min	$0.24	mandatory fail
task-0015	Bulk-import a migration batch into StaffLine	0	20/25	80 (3 failed)	6 min	$0.08	mandatory fail
task-0016	HireWire connector: push stage-change events + keep an incremental poll fresh	92	45/48	107 (4 failed)	33 min	$0.11	resolved
task-0020	Sync GlobalHire candidates into our canonical store (offset polling)	100	34/34	89 (5 failed)	8 min	$0.08	resolved
task-0025	Reset the CrewCall roster watermark after the tenant rebuild	0	500/503	58 (4 failed)	9 min	$0.04	partial
task-0037	Fix the Placemint redeployment sync	100	306/306	130 (9 failed)	52 min	$0.24	resolved
task-0042	Move the rota mirror onto instant storage	100	117/117	64 (5 failed)	26 min	$0.08	resolved
task-0047	Reconcile and safely apply the mobility stage repair queue	0	99/100	90	25 min	$0.08	partial
task-0049	Placemint connector: webhooks, polling, and writeback for a high-volume tenant	100	68/68	106 (7 failed)	44 min	$0.14	resolved