Models on Integration Bench
Every model evaluated on Integration Bench rev 01 with its per-task results.
Integration capability of coding agents on Claude Fable 5
Claude Fable 5 scored 67.68 on Integration Bench rev 01, resolving 34 of 50 public integration tasks. Per-task scores, cost, tool calls and a link to every trajectory.
Integration capability of coding agents on Claude Fable 5.1
Claude Fable 5.1 scored 69.35 on Integration Bench rev 01, resolving 35 of 50 public integration tasks. Per-task scores, cost, tool calls and a link to every trajectory.
Integration capability of coding agents on Claude Opus 5
Claude Opus 5 scored 59.32 on Integration Bench rev 01, resolving 30 of 50 public integration tasks. Per-task scores, cost, tool calls and a link to every trajectory.
Integration capability of coding agents on Claude Sonnet 5
Claude Sonnet 5 scored 53.85 on Integration Bench rev 01, resolving 27 of 50 public integration tasks. Per-task scores, cost, tool calls and a link to every trajectory.
Integration capability of coding agents on DeepSeek V4 Flash (max)
DeepSeek V4 Flash (max) scored 55.68 on Integration Bench rev 01, resolving 28 of 50 public integration tasks. Per-task scores, cost, tool calls and a link to every trajectory.
Integration capability of coding agents on DeepSeek V4 Pro (max)
DeepSeek V4 Pro (max) scored 63.35 on Integration Bench rev 01, resolving 32 of 50 public integration tasks. Per-task scores, cost, tool calls and a link to every trajectory.
Integration capability of coding agents on Gemini 3.8 Flash
Gemini 3.8 Flash scored 59.68 on Integration Bench rev 01, resolving 30 of 50 public integration tasks. Per-task scores, cost, tool calls and a link to every trajectory.
Integration capability of coding agents on GLM 5.2 (xhigh)
GLM 5.2 (xhigh) scored 49.68 on Integration Bench rev 01, resolving 25 of 50 public integration tasks. Per-task scores, cost, tool calls and a link to every trajectory.
Integration capability of coding agents on GLM 5.3
GLM 5.3 scored 57.31 on Integration Bench rev 01, resolving 29 of 50 public integration tasks. Per-task scores, cost, tool calls and a link to every trajectory.
Integration capability of coding agents on GLM 5.3 Flash
GLM 5.3 Flash scored 59.37 on Integration Bench rev 01, resolving 30 of 50 public integration tasks. Per-task scores, cost, tool calls and a link to every trajectory.
Integration capability of coding agents on GPT-5.6 Luna
GPT-5.6 Luna scored 51.78 on Integration Bench rev 01, resolving 26 of 50 public integration tasks. Per-task scores, cost, tool calls and a link to every trajectory.
Integration capability of coding agents on GPT-5.6 Sol
GPT-5.6 Sol scored 63.62 on Integration Bench rev 01, resolving 32 of 50 public integration tasks. Per-task scores, cost, tool calls and a link to every trajectory.
Integration capability of coding agents on GPT-5.6 Terra
GPT-5.6 Terra scored 53.79 on Integration Bench rev 01, resolving 27 of 50 public integration tasks. Per-task scores, cost, tool calls and a link to every trajectory.
Integration capability of coding agents on GPT-6 Astra
GPT-6 Astra scored 65.40 on Integration Bench rev 01, resolving 33 of 50 public integration tasks. Per-task scores, cost, tool calls and a link to every trajectory.
Integration capability of coding agents on Grok 4.6
Grok 4.6 scored 61.18 on Integration Bench rev 01, resolving 31 of 50 public integration tasks. Per-task scores, cost, tool calls and a link to every trajectory.
Integration capability of coding agents on Kimi K3
Kimi K3 scored 57.47 on Integration Bench rev 01, resolving 29 of 50 public integration tasks. Per-task scores, cost, tool calls and a link to every trajectory.
Integration capability of coding agents on Muse Spark 1.2
Muse Spark 1.2 scored 53.70 on Integration Bench rev 01, resolving 27 of 50 public integration tasks. Per-task scores, cost, tool calls and a link to every trajectory.
Integration capability of coding agents on Muse Spark 1.3
Muse Spark 1.3 scored 57.66 on Integration Bench rev 01, resolving 29 of 50 public integration tasks. Per-task scores, cost, tool calls and a link to every trajectory.
Integration capability of coding agents on Qwen 3.8 2.4T A95B
Qwen 3.8 2.4T A95B scored 61.68 on Integration Bench rev 01, resolving 31 of 50 public integration tasks. Per-task scores, cost, tool calls and a link to every trajectory.
Integration capability of coding agents on Qwen 3.8 27B (xhigh)
Qwen 3.8 27B (xhigh) scored 57.73 on Integration Bench rev 01, resolving 29 of 50 public integration tasks. Per-task scores, cost, tool calls and a link to every trajectory.
Integration capability of coding agents on Tencent HY 4 Preview
Tencent HY 4 Preview scored 62.62 on Integration Bench rev 01, resolving 32 of 50 public integration tasks. Per-task scores, cost, tool calls and a link to every trajectory.