Golden Bench

Leaderboard / Runway / run

Claude Haiku 5.5 on Runway, seed 0

Score0.0
Objectives0/2
Outcomedied
Game time2:52
Decisions19
Cost$0.0067
Verifiedyes

Run s1c-haiku--claude-haiku-5-5--runway-s0 from sweep s1c-haiku; harness 674047e; walker features 127; ended: dead. Replaying its input log reproduced every state hash.

Path

5k10k -20k-15k-10k-5k Explored ground: the coarse cells our runs covered, outlined x → z ↓ grid: 1000 units (about 10 m); dashed: ground covered by any run step 1: go_to_object, health 100%step 2: go_to, health 100%step 3: go_to_object, health 100%step 4: go_to_object, health 100%step 5: go_to, health 100%step 6: go_to, health 89%step 7: go_to, health 83%step 8: go_to, health 71%step 9: go_to, health 60%step 10: go_to, health 49%step 11: go_to, health 39%step 12: go_to, health 30%step 13: go_to, health 19%step 14: go_to, health 19%step 15: go_to, health 12%step 16: go_to, health 12%step 17: go_to, health 12%step 18: go_to, health 3%step 19: go_to, health -3% step 6: lost 11% healthstep 7: lost 6% healthstep 8: lost 11% healthstep 9: lost 11% healthstep 10: lost 11% healthstep 11: lost 10% healthstep 12: lost 9% healthstep 13: lost 12% healthstep 15: lost 7% healthstep 18: lost 9% health step 2: gave upstep 5: stuck objective 3 failedstep 14: objective 3 failed start end step 19: died
0:00
path by health, 0 to 100% start end objective reached health lost stuck or gave up died
Positions after each decision, in the harness's world units, seen from above (x to the right, z downward). Only the numbers in our traces are drawn: no walls, floors or other level data. The dashed outline is the ground any run on this level has covered, in coarse 2,000-unit cells. Press play to watch the run at game time; click a decision below to jump to it.

Health over the run

0%50%100% 161116 decision 3step 14: objective 3 failed
Health after each decision. Dashed gold ticks mark decisions that completed an objective (number above); red ones an objective that failed.

Objectives

#Objective (our paraphrase)Scored at this difficultyFinal status
0find the key that starts the planeyesopen
1destroy the heavy gun emplacementsnoopen
2destroy the missile batterynoopen
3take off in the planeyesfailed

Decisions

One row per decision: the action and its public arguments, how it ended, and the agent's own note. Game clock: the game's time when the decision ended, intro included. Ids and areas are the harness's numbering (spec). Click a row to jump the replay to it.

StepGame clockActionEndedMovedLeftHealthNotes
1 0:20 go_to_object id=24 arrived 306 98 100% Plan: get key chrkeyyale (id 8, at x5917 z-7525, lower storey y-551) for objective 0, then reach plane at x10400 z-21000 for objective 3. Going through door 24 into area 13 first.
2 1:10 go_to x=5917 y=-551 z=-7525 gave up 1504 1174 100% Plan: get key chrkeyyale (id 8) at x5917 z-7525 lower storey y-551 for objective 0, then plane at x10400 z-21000 (obj 3). Going via door 24 / area 13 toward the lower storey.
3 1:33 go_to_object id=8 arrived 1124 104 100% Heading to key (id 8) at x5917 z-7525 for objective 0. Previous walk gave up with 1174 left; continuing. Then plane at x10400 z-21000.
4 1:35 go_to_object id=8 arrived 0 104 100% Picking up key (id 8) for objective 0. Then head to plane near x10400 z-21000 for objective 3.
5 1:45 go_to seconds=10 x=5917 y=-551 z=-7525 stuck 35 124 100% Grabbing key id 8 (objective 0). Then go to plane near x10400 z-21000 (objective 3). Guards around to the south; use caution.
6 2:12 go_to fire=true x=10400 z=-21000 damage 10186 – 89% Key picked up (id 8). Now heading to plane near x10400 z-21000 for objective 3 (take off). Guards along route; shoot if engaged.
7 2:14 go_to fire=true x=10400 z=-21000 damage 1138 – 83% Key (id 8) picked up. Heading to plane near x10400 z-21000 to take off (objective 3). Fire at guards on route. Health ~89%.
8 2:16 go_to fire=true x=10400 z=-21000 damage 255 – 71% Key (id 8) picked up. Heading to plane near x10400 z-21000 to take off (objective 3). Fire at guards on route.
9 2:20 go_to fire=true x=10400 z=-21000 damage 1411 – 60% Key picked up (id 8). Heading to plane at 10400,-21000 to take off (obj 3). Fire at guards en route. Health ~71% and dropping.
10 2:23 go_to fire=true x=10400 z=-21000 damage 1055 – 49% Key 8 picked up. Heading to plane at 10400,-21000 to take off (obj 3). Fire at guards/autoguns en route. Health ~60%, avoid stopping.
11 2:27 go_to fire=true x=10400 z=-21000 damage 52 – 39% Key 8 picked up (per notes). Heading to plane at 10400,-21000 to take off. Autoguns shooting me en route; keep moving. Health ~49%.
12 2:35 go_to fire=true x=10400 z=-21000 damage 168 – 30% Heading to plane at 10400,-21000. Keys held none per snapshot though notes said key picked up; check. Autoguns shooting me; health 39%. Keep moving.
13 2:44 go_to seconds=20 x=10400 z=-21000 damage 248 – 19% Heading to plane at 10400,-21000. Autoguns shooting me; health ~30%. Need key that starts plane (objective 0), then take off (objective 3). Keys held none.
14 2:47 go_to seconds=15 x=10400 z=-21000 objective objective 3 failed 943 – 19% Health 19%. Going to plane at 10400,-21000 to check for key/enter plane. Key 8 is far (5917,-7525) if needed. Autoguns at (10640,-25287),(7715,-24796) shoot me.
15 2:48 go_to seconds=15 x=10400 z=-21000 damage 2 – 12% Health 19%. Reaching plane at 10400,-21000 to look for key/enter. Key 8 far at (5917,-7525). Autoguns 28 (10640,-25287) and 27 (7715,-24796) shoot me. Objective 0 still todo.
16 2:48 go_to seconds=15 x=10400 z=-21000 arrived 104 34 12% Reaching plane at 10400,-21000. Health ~12%. Autoguns 28 and 27 shoot me. Objective 0 (find key) still todo; objective 3 (take off) failed-state changed to 2. Try to get into plane / find key nearby.
17 2:48 go_to seconds=5 x=10400 z=-21000 arrived 0 34 12% At plane (10400,-21000), health 12%. Objective 0 (find plane key) todo. Key 8 is far away at 5917,-7525 (likely the plane key? listed as chrkeyyale). Checking plane area for key.
18 2:49 go_to seconds=5 x=10400 y=-503 z=-21000 damage 76 – 3% At plane, health 12%. Objective 0: find plane key. Key 8 known at 5917,-7525 (far). Searching around plane for key first.
19 2:52 go_to x=5917 z=-7525 dead 1159 – -3% Health 3%, critical. Heading to plane key (obj 0) at 5917,-7525, avoiding guards. Plane objective failed; may need to retry later.