62
polling
62% of tasks touching this surface resolved
Qwen 3.8 27B (xhigh)
62
writeback
62% of tasks touching this surface resolved
18
webhooks
18% of tasks touching this surface resolved
Published attempts
10 of 50 scored tasks released
One official run per task. Click a row for the full trajectory: every tool call, vendor request, graded check and the diff.
| Task | Score | Checks | Outcome |
|---|---|---|---|
| task-0001 | 100 | 30/30 | resolved |
| task-0011 | 0 | 56/60 | mandatory fail timed out |
| task-0015 | 100 | 26/26 | resolved |
| task-0016 | 92 | 45/48 | resolved |
| task-0020 | 100 | 34/34 | resolved timed out |
| task-0025 | 0 | 500/503 | partial |
| task-0037 | 0 | 306/306 | partial |
| task-0042 | 0 | 76/117 | partial |
| task-0047 | 100 | 100/100 | resolved |
| task-0049 | 100 | 61/61 | resolved timed out |