Netlify Agent Runners

One brief, 11 models

Every model below was given the same brief on Netlify Agent Runners, up to 3 attempts each. These are the pages they built, and what each attempt cost.

The brief

Build a one-page site for a neighbourhood coffee shop: opening hours, the address, a short menu and a photo. Nothing on it changes unless I edit it myself.

What it cost

Most expensive first, newest run last. Pick a model to jump to its pages.

Model Credits per run Average
Claude Opus 5 Agent: Claude Code 253, 249, 1,055 519
Claude Sonnet 5 Agent: Claude Code 81, 245, 103 143
GPT 5.6 Sol Agent: Codex CLI 173, 158, 92 141
Gemini 3.6 Flash Agent: Gemini CLI 109, 91, 111 103
Kimi K3 Agent: OpenCode 125, 95, 86 102
Gemini 3.1 Pro Agent: Gemini CLI 57, 52, 49 53
GPT 5.6 Terra Agent: Codex CLI 43, 23, 49 39
Deepseek v4 Pro Agent: OpenCode 47, 30, 33 37
GLM 5.2 Agent: OpenCode 15, 42, 24 27
Kimi K2.7 Code Agent: OpenCode 18, 17, 19 18
Deepseek v4 Flash Agent: OpenCode 3.4, 1.3, 2.5 2.4

Claude Opus 5

Agent: Claude Code · 519 credits on average across 3 runs

Claude Sonnet 5

Agent: Claude Code · 143 credits on average across 3 runs

GPT 5.6 Sol

Agent: Codex CLI · 141 credits on average across 3 runs

Gemini 3.6 Flash

Agent: Gemini CLI · 103 credits on average across 3 runs

Kimi K3

Agent: OpenCode · 102 credits on average across 3 runs

Gemini 3.1 Pro

Agent: Gemini CLI · 53 credits on average across 3 runs

GPT 5.6 Terra

Agent: Codex CLI · 39 credits on average across 3 runs

Deepseek v4 Pro

Agent: OpenCode · 37 credits on average across 3 runs

GLM 5.2

Agent: OpenCode · 27 credits on average across 3 runs

Kimi K2.7 Code

Agent: OpenCode · 18 credits on average across 3 runs

Deepseek v4 Flash

Agent: OpenCode · 2.4 credits on average across 3 runs