v2.studio · see what AI actually builds

03 PUBLISHED VBENCH ROUNDS

Same brief. Six configurations. One shot each.

03 BRIEFS · 18 ARTIFACTS RECOVERED · GRADED ROUNDS IDENTIFIED IN PLACE

Pilot evidence predates the levelled harness. Any released pilot round is shown as-is and excluded from cross-vendor conclusions; protocol v1 is the canonical series.

R03 · MAP V1

World Map From Memory

The brief asked for a world map drawn from memory.

Fable 5 wins decisively with the only map that genuinely looks like Earth, Sol close behind. Every toggle worked, so the round came down to geographic memory.

06 / 06 ARTIFACTS RECOVERED

VIEW FULL ROUND

GPT-5.6 SOL

P.01 / 06 6M 38S

OK · ONE SHOT · NO RETRY

GPT-5.6 TERRA

P.02 / 06 6M 02S

OK · ONE SHOT · NO RETRY

GPT-5.6 LUNA

P.03 / 06 8M 53S

OK · ONE SHOT · NO RETRY

FABLE 5

P.04 / 06 25M 33S

OK · ONE SHOT · NO RETRY

OPUS 4.8

P.05 / 06 17M 41S

OK · ONE SHOT · NO RETRY

SONNET

P.06 / 06 20M 45S

OK · ONE SHOT · NO RETRY

R01 · BRIEF A · GAME PILOT

Lighthouse Keeper

The brief asked for a playable browser game.

06 / 06 ARTIFACTS RECOVERED

VIEW FULL ROUND

GPT-5.6 SOL

P.01 / 06 10M 31S

OK · ONE SHOT · NO RETRY

GPT-5.6 TERRA

P.02 / 06 13M 16S

OK · ONE SHOT · NO RETRY

GPT-5.6 LUNA

P.03 / 06 12M 38S

OK · ONE SHOT · NO RETRY

FABLE 5

P.04 / 06 10M 10S

OK · ONE SHOT · NO RETRY

OPUS 4.8

P.05 / 06 8M 06S

OK · ONE SHOT · NO RETRY

SONNET

P.06 / 06 39M 43S

OK · ONE SHOT · NO RETRY

R05 · SHOW V1

Fireworks Finale

The brief asked for a 60-second fireworks finale.

Opus 4.8 and Sol 5.6 tie for the win with the only genuinely layered shows. Fable 5 shipped complete machinery with near-invisible bursts: structure without spectacle.

06 / 06 ARTIFACTS RECOVERED

VIEW FULL ROUND

GPT-5.6 SOL

P.01 / 06 8M 29S

OK · ONE SHOT · NO RETRY

GPT-5.6 TERRA

P.02 / 06 10M 34S

OK · ONE SHOT · NO RETRY

GPT-5.6 LUNA

P.03 / 06 14M 32S

OK · ONE SHOT · NO RETRY

FABLE 5

P.04 / 06 11M 16S

OK · ONE SHOT · NO RETRY

OPUS 4.8

P.05 / 06 13M 17S

OK · ONE SHOT · NO RETRY

SONNET

P.06 / 06 17M 22S

OK · ONE SHOT · NO RETRY

HOW VBENCH WORKS

A narrow test with a public record.

SAME BRIEF

Six frontier model configurations receive one identical build brief, sent verbatim. Every recovered artifact is one self-contained HTML file a model wrote, run without repair in a network-blocked sandbox.

ONE REPLY

Within each released round, every configuration gets one prompt and one reply, with no retries or best-of selection. Each is reached through its command-line client with customization stripped, and every run records the exact command, wall time, and outcome.

FAILURES REMAIN VISIBLE

A run that produced nothing stays visible if its round is released, with the reason attributed. Recorded failures can come from the harness rather than the model, and the page says which is which.

SCOPE · IT TESTS A NARROW BUILD WORKFLOW, NOT GENERAL INTELLIGENCE. NO WINNER IS DECLARED.

Built and evaluated by Victor Iglesias. For higher-ed AI evaluation and learning-technology work: victormiglesias.com

READ THE FULL METHODOLOGY

See what AI actually builds.

Same brief. Six configurations. One shot each.

World Map From Memory

Lighthouse Keeper

Fireworks Finale

Can you tell who built it?

A narrow test with a public record.

OTHER SYSTEMS FROM THE STUDIO

Same brief. Six configurations. One shot each.

Can you tell who built it?

A narrow test with a public record.

+OTHER SYSTEMS FROM THE STUDIO

OTHER SYSTEMS FROM THE STUDIO