Evidence

Results

Every number in the thesis comes from a result file. A cell is one configuration with one model on one floor (or the tower), played N times. The cells are grouped as in the thesis (Appendix D, Table D.4); open one for its settings, every episode with a replay, and the command that re-runs it in mt-ai-lab.

27 groups · 177 cells cited by the thesis · 128 further cells · data from mt-ai-lab v1.0.1. Wins count episodes that defeated the boss alive; tower cells report the highest floor reached.

6.1 Setup and final configuration

Section 6.1 in the thesis
Section 6.1.2, tower settings on single floors

Files: <floor>_<m>_canon_hp60 (prompt floor_basic_hp60.txt, MOTA_HP_RULE_PCT=60; the solver-route cells keep their prompt) and …_canon_planmem (MOTA_PLAN_MEMORY=1), Qwen3.5-397B and DeepSeek-V4-Flash

modelfloorNwins [95 % CI] · tower: highest floorHP / optdiedconfiguration
Simple floor
DeepSeek-V4-FlashSimple floor50/5 [0.00, 0.43]–0canon_hp60
Qwen3.5-397BSimple floor52/5 [0.12, 0.77]15%0canon_hp60
DeepSeek-V4-FlashSimple floor52/5 [0.12, 0.77]15%0canon_planmem
Qwen3.5-397BSimple floor52/5 [0.12, 0.77]15%0canon_planmem
Complex floor
DeepSeek-V4-FlashComplex floor50/5 [0.00, 0.43]–0canon_hp60
Qwen3.5-397BComplex floor50/5 [0.00, 0.43]–0canon_hp60
DeepSeek-V4-FlashComplex floor50/5 [0.00, 0.43]–0canon_planmem
Qwen3.5-397BComplex floor50/5 [0.00, 0.43]–0canon_planmem
DeepSeek-V4-FlashComplex floor53/5 [0.23, 0.88]18%0route_canon_hp60
Qwen3.5-397BComplex floor55/5 [0.57, 1.00]28%0route_canon_hp60
DeepSeek-V4-FlashComplex floor54/5 [0.38, 0.96]26%0route_canon_planmem
Qwen3.5-397BComplex floor52/5 [0.12, 0.77]32%0route_canon_planmem
Table 6.2, single-floor columns (re-run of Table 6.2, N = 5)

Files: simple_<m>_canon, complex_<m>_canon (single-floor prompt), complex_route_<m>_canon (solver-route prompt; Qwen3.6-35B N = 10), hand0<i>_<m>_canon; table compiled by analysis/table62_canon.py

modelfloorNwins [95 % CI] · tower: highest floorHP / optdiedconfiguration
Simple floor
DeepSeek-V4-FlashSimple floor51/5 [0.04, 0.62]15%0canon
Mistral-Medium-3.5Simple floor50/5 [0.00, 0.43]–0canon
Qwen3.5-397BSimple floor55/5 [0.57, 1.00]15%0canon
Qwen3.6-35BSimple floor51/5 [0.04, 0.62]15%0canon
Complex floor
DeepSeek-V4-FlashComplex floor50/5 [0.00, 0.43]–0canon
Mistral-Medium-3.5Complex floor50/5 [0.00, 0.43]–0canon
Qwen3.5-397BComplex floor50/5 [0.00, 0.43]–0canon
Qwen3.6-35BComplex floor50/5 [0.00, 0.43]–0canon
DeepSeek-V4-FlashComplex floor54/5 [0.38, 0.96]26%0route_canon
Mistral-Medium-3.5Complex floor50/5 [0.00, 0.43]–4route_canon
Qwen3.5-397BComplex floor53/5 [0.23, 0.88]25%1route_canon
Qwen3.6-35BComplex floor104/10 [0.17, 0.69]20%3route_canon
hand01
DeepSeek-V4-Flashhand0154/5 [0.38, 0.96]66%0canon
Mistral-Medium-3.5hand0155/5 [0.57, 1.00]64%0canon
Qwen3.5-397Bhand0155/5 [0.57, 1.00]50%0canon
Qwen3.6-35Bhand0154/5 [0.38, 0.96]64%0canon
hand02
DeepSeek-V4-Flashhand0255/5 [0.57, 1.00]28%0canon
Mistral-Medium-3.5hand0255/5 [0.57, 1.00]86%0canon
Qwen3.5-397Bhand0254/5 [0.38, 0.96]48%0canon
Qwen3.6-35Bhand0253/5 [0.23, 0.88]31%0canon
hand03
DeepSeek-V4-Flashhand0350/5 [0.00, 0.43]–0canon
Mistral-Medium-3.5hand0350/5 [0.00, 0.43]–0canon
Qwen3.5-397Bhand0350/5 [0.00, 0.43]–0canon
Qwen3.6-35Bhand0350/5 [0.00, 0.43]–0canon
hand04
DeepSeek-V4-Flashhand0450/5 [0.00, 0.43]–0canon
Mistral-Medium-3.5hand0450/5 [0.00, 0.43]–0canon
Qwen3.5-397Bhand0450/5 [0.00, 0.43]–0canon
Qwen3.6-35Bhand0450/5 [0.00, 0.43]–0canon
Table 6.2, tower column

Files: the final-observation rows of Table 6.13

modelfloorNwins [95 % CI] · tower: highest floorHP / optdiedconfiguration
DeepSeek-V4-FlashTower MT0→MT23w3MT17, MT8, MT17–0final11_reactive
Mistral-Medium-3.5Tower MT0→MT23w3MT8, MT4, MT4–0final11_reactive
Qwen3.5-397BTower MT0→MT23w3MT18, MT8, MT8–0final11_reactive
Qwen3.6-35BTower MT0→MT23w3MT8, MT8, MT16–0final11_reactive
Section 6.2 and Table 6.3 (earlier episodes of the final configuration, depth 3), Table 6.5 (row 9)

Files: simple_<m>_final2_la3 (Qwen3.5-397B, Qwen3.6-35B)

modelfloorNwins [95 % CI] · tower: highest floorHP / optdiedconfiguration
Qwen3.5-397BSimple floor1010/10 [0.72, 1.00]15%0final2_la3
Qwen3.6-35BSimple floor107/10 [0.40, 0.89]15%0final2_la3
Temperatures 0.6 and 1.0 (Section 6.3, Table 6.3)

Files: the file of the temperature-0 cell with the suffix _t06 or _t10: simple_<m>_canon_t06, complex_<m>_canon_t06, complex_route_<m>_canon_t06 and the same with _t10 (Qwen3.5-397B, DeepSeek-V4-Flash)

modelfloorNwins [95 % CI] · tower: highest floorHP / optdiedconfiguration
Simple floor
Qwen3.5-397BSimple floor53/5 [0.23, 0.88]15%0basic_d1d4_t06
DeepSeek-V4-FlashSimple floor51/5 [0.04, 0.62]15%0canon_t06
Qwen3.5-397BSimple floor55/5 [0.57, 1.00]15%0canon_t06
DeepSeek-V4-FlashSimple floor52/5 [0.12, 0.77]15%0canon_t10
Qwen3.5-397BSimple floor55/5 [0.57, 1.00]15%0canon_t10
Qwen3.5-397BSimple floor55/5 [0.57, 1.00]15%0final2_la3_t06
Qwen3.5-397BSimple floor54/5 [0.38, 0.96]31%0final2_la3_t10
DeepSeek-V4-FlashSimple floor50/5 [0.00, 0.43]–0final2_plan3_t06
Qwen3.5-397BSimple floor50/5 [0.00, 0.43]–0final2_plan3_t06
DeepSeek-V4-FlashSimple floor52/5 [0.12, 0.77]15%0final2_reactive_t32_t06
Complex floor
DeepSeek-V4-FlashComplex floor50/5 [0.00, 0.43]–0canon_t06
Qwen3.5-397BComplex floor50/5 [0.00, 0.43]–0canon_t06
DeepSeek-V4-FlashComplex floor50/5 [0.00, 0.43]–0canon_t10
Qwen3.5-397BComplex floor50/5 [0.00, 0.43]–0canon_t10
DeepSeek-V4-FlashComplex floor54/5 [0.38, 0.96]25%0route_canon_t06
Qwen3.5-397BComplex floor53/5 [0.23, 0.88]29%0route_canon_t06
DeepSeek-V4-FlashComplex floor53/5 [0.23, 0.88]18%1route_canon_t10
Qwen3.5-397BComplex floor54/5 [0.38, 0.96]26%0route_canon_t10
DeepSeek-V4-FlashComplex floor54/5 [0.38, 0.96]28%0survival_final2_plan5_t06
DeepSeek-V4-FlashComplex floor108/10 [0.49, 0.94]26%1survival_final2_reactive_t32_t06
DeepSeek-V4-FlashComplex floor52/5 [0.12, 0.77]24%0survival_final2_reactive_t32_t10
hand03
DeepSeek-V4-Flashhand0350/5 [0.00, 0.43]–0final2_t06
hand04
DeepSeek-V4-Flashhand0450/5 [0.00, 0.43]–0final2_t06
Table 6.3, bare observation

Files: results/gepa_study/gs_397b_bare.json, gs_35b_bare.json

modelfloorNwins [95 % CI] · tower: highest floorHP / optdiedconfiguration
prompt-optimisation result (see Prompt optimisation)gs_35b_bare
prompt-optimisation result (see Prompt optimisation)gs_397b_bare
Tables 6.3 and 6.4, map only

Files: simple_qwen3.5-397b_mapenum, simple_qwen3.6-35b_mapenum; Table 6.4 counted from the visible answers by analysis/mapenum_rescore.py (the map_enum fields of the result files also count options named in the reasoning)

modelfloorNwins [95 % CI] · tower: highest floorHP / optdiedconfiguration
Qwen3.5-397BSimple floor20/2 [0.00, 0.66]–0mapenum
Qwen3.6-35BSimple floor20/2 [0.00, 0.66]–0mapenum
Table 6.3, lookahead depth

Files: simple_<m>_final2_la<d>

modelfloorNwins [95 % CI] · tower: highest floorHP / optdiedconfiguration
Qwen3.5-397BSimple floor30/3 [0.00, 0.56]–0final2_la0
Qwen3.6-35BSimple floor50/5 [0.00, 0.43]–0final2_la0
Qwen3.5-397BSimple floor30/3 [0.00, 0.56]–0final2_la1
Qwen3.6-35BSimple floor50/5 [0.00, 0.43]–0final2_la1
Qwen3.5-397BSimple floor54/5 [0.38, 0.96]15%0final2_la2
Qwen3.6-35BSimple floor107/10 [0.40, 0.89]27%0final2_la2
Qwen3.5-397BSimple floor1010/10 [0.72, 1.00]15%0final2_la3
Qwen3.6-35BSimple floor107/10 [0.40, 0.89]15%0final2_la3
Table 6.3, conversation history

Files: simple_qwen3.5-397b_basic_k1k2, simple_qwen3.6-35b_basic_k1k2_16k; without history …_hist0

modelfloorNwins [95 % CI] · tower: highest floorHP / optdiedconfiguration
Qwen3.5-397BSimple floor1010/10 [0.72, 1.00]15%0basic_k1k2
Qwen3.6-35BSimple floor51/5 [0.04, 0.62]15%0basic_k1k2_16k
Qwen3.6-35BSimple floor1010/10 [0.72, 1.00]15%0basic_k1k2_16k_hist0
Qwen3.5-397BSimple floor109/10 [0.60, 0.98]22%0basic_k1k2_hist0
Section 6.3, hand01 and hand02 at depth 3

Files: hand0<i>_deepseek-v4-flash_final2 (32,768 tokens: …_reactive_t32)

modelfloorNwins [95 % CI] · tower: highest floorHP / optdiedconfiguration
hand01
DeepSeek-V4-Flashhand0154/5 [0.38, 0.96]68%0final2
DeepSeek-V4-Flashhand0155/5 [0.57, 1.00]66%0final2_reactive_t32
hand02
DeepSeek-V4-Flashhand0255/5 [0.57, 1.00]31%0final2
DeepSeek-V4-Flashhand0254/5 [0.38, 0.96]29%0final2_reactive_t32
hand03
DeepSeek-V4-Flashhand0350/5 [0.00, 0.43]–0final2
hand04
DeepSeek-V4-Flashhand0450/5 [0.00, 0.43]–0final2
Section 6.3, hand01 and hand02 at depth 1 and with the bare observation

Files: hand0<i>_deepseek-v4-flash_final2_la1, …_bare

modelfloorNwins [95 % CI] · tower: highest floorHP / optdiedconfiguration
hand01
DeepSeek-V4-Flashhand0150/5 [0.00, 0.43]–0final2_bare
DeepSeek-V4-Flashhand0155/5 [0.57, 1.00]57%0final2_la1
hand02
DeepSeek-V4-Flashhand0250/5 [0.00, 0.43]–0final2_bare
DeepSeek-V4-Flashhand0254/5 [0.38, 0.96]25%0final2_la1

6.4 Error analysis

Section 6.4 in the thesis
Section 6.4.1, override census

Files: analysis/override_census.py over the stored run logs (94 replaced turns in 68 episodes)

Computed from the run logs; no separate result file.

Table 6.5 and Figure 6.1, rows 1 to 9

Files: simple_<m>_ followed by legacy_strategic_control, basic_mechanical_override, basic_mech_altroute, basic_order_aware, basic_d1d4, basic_k1k2 (Qwen3.6-35B: basic_k1k2_16k), basic_k1k2_hist0 (Qwen3.6-35B: basic_k1k2_16k_hist0), final_la3, final2_la3

modelfloorNwins [95 % CI] · tower: highest floorHP / optdiedconfiguration
Qwen3.5-397BSimple floor54/5 [0.38, 0.96]15%0basic_d1d4
Qwen3.6-35BSimple floor51/5 [0.04, 0.62]15%0basic_d1d4
Qwen3.8-27BSimple floor31/3 [0.06, 0.79]15%0basic_d1d4
Qwen3.5-397BSimple floor1010/10 [0.72, 1.00]15%0basic_k1k2
Qwen3.6-35BSimple floor51/5 [0.04, 0.62]15%0basic_k1k2_16k
Qwen3.6-35BSimple floor1010/10 [0.72, 1.00]15%0basic_k1k2_16k_hist0
Qwen3.5-397BSimple floor109/10 [0.60, 0.98]22%0basic_k1k2_hist0
Qwen3.5-397BSimple floor50/5 [0.00, 0.43]–0basic_mech_altroute
Qwen3.5-397BSimple floor50/5 [0.00, 0.43]–0basic_mechanical_override
Qwen3.5-397BSimple floor1010/10 [0.72, 1.00]15%0basic_order_aware
Qwen3.6-35BSimple floor50/5 [0.00, 0.43]–0basic_order_aware
Qwen3.5-397BSimple floor107/10 [0.40, 0.89]15%0final_la3
Qwen3.6-35BSimple floor101/10 [0.02, 0.40]15%0final_la3
Qwen3.5-397BSimple floor1010/10 [0.72, 1.00]15%0final2_la3
Qwen3.6-35BSimple floor107/10 [0.40, 0.89]15%0final2_la3
Qwen3.5-397BSimple floor42/4 [0.15, 0.85]15%0legacy_strategic_control
Section 6.4.5, Table B.3 and Figure 6.2

Files: complex_value_trace_[a-e].json, written by analysis/complex_value_trace.py and summarised by analysis/complex_value_summary.py

modelfloorNwins [95 % CI] · tower: highest floorHP / optdiedconfiguration
result file (raw JSON)complex_value_trace_a
result file (raw JSON)complex_value_trace_b
result file (raw JSON)complex_value_trace_c
result file (raw JSON)complex_value_trace_d
result file (raw JSON)complex_value_trace_e

6.5 Prompt optimisation (RQ2)

Section 6.5 in the thesis
Table 6.6

Files: results/gepa_study/gs_* (first configuration), gs2_* (second configuration); loops in results/gepa/gepa_result_gs_*.json and …_gs2_*.json; reference runs on the simple floor gs_397b_*, gs_35b_*

modelfloorNwins [95 % CI] · tower: highest floorHP / optdiedconfiguration
result file (raw JSON)gepa_result_gs2_dsv4flash_bare
result file (raw JSON)gepa_result_gs2_dsv4flash_full
result file (raw JSON)gepa_result_gs2_llama8b_bare
result file (raw JSON)gepa_result_gs2_llama8b_full
result file (raw JSON)gepa_result_gs_dsv4flash_bare
result file (raw JSON)gepa_result_gs_dsv4flash_full
result file (raw JSON)gepa_result_gs_llama8b_bare
result file (raw JSON)gepa_result_gs_llama8b_full
prompt-optimisation result (see Prompt optimisation)gs2_dsv4flash_bare
prompt-optimisation result (see Prompt optimisation)gs2_dsv4flash_full
prompt-optimisation result (see Prompt optimisation)gs2_llama8b_bare
prompt-optimisation result (see Prompt optimisation)gs2_llama8b_full
prompt-optimisation result (see Prompt optimisation)gs_35b_bare
prompt-optimisation result (see Prompt optimisation)gs_35b_full
prompt-optimisation result (see Prompt optimisation)gs_397b_bare
prompt-optimisation result (see Prompt optimisation)gs_397b_full
prompt-optimisation result (see Prompt optimisation)gs_dsv4flash_bare
prompt-optimisation result (see Prompt optimisation)gs_dsv4flash_bare_k1
prompt-optimisation result (see Prompt optimisation)gs_dsv4flash_full
prompt-optimisation result (see Prompt optimisation)gs_llama8b_bare
prompt-optimisation result (see Prompt optimisation)gs_llama8b_full
Table 6.7

Files: analysis/gepa_rule_themes.py over the candidates in results/gepa/gepa_result_gs*_*.json

modelfloorNwins [95 % CI] · tower: highest floorHP / optdiedconfiguration
result file (raw JSON)gepa_result_gs2_dsv4flash_bare
result file (raw JSON)gepa_result_gs2_dsv4flash_full
result file (raw JSON)gepa_result_gs2_llama8b_bare
result file (raw JSON)gepa_result_gs2_llama8b_full
result file (raw JSON)gepa_result_gs4_complex_35b
result file (raw JSON)gepa_result_gs5_oneplusone_dsthink_bare
result file (raw JSON)gepa_result_gs5_pareto_dsthink_bare
result file (raw JSON)gepa_result_gs_dsv4flash_bare
result file (raw JSON)gepa_result_gs_dsv4flash_full
result file (raw JSON)gepa_result_gs_llama8b_bare
result file (raw JSON)gepa_result_gs_llama8b_full
Section 6.5.2 and Figure 6.3, paired confirmation

Files: results/gepa_study/gs3_dsbare_confirm.json

modelfloorNwins [95 % CI] · tower: highest floorHP / optdiedconfiguration
prompt-optimisation result (see Prompt optimisation)gs3_dsbare_confirm
Section 6.5.2, complex floor

Files: results/gepa_study/gs4_complex_35b.json (loop: results/gepa/gepa_result_gs4_complex_35b.json)

modelfloorNwins [95 % CI] · tower: highest floorHP / optdiedconfiguration
result file (raw JSON)gepa_result_gs4_complex_35b
prompt-optimisation result (see Prompt optimisation)gs4_complex_35b
Table 6.8, second study

Files: results/gepa_study/gs5_pareto_dsthink_bare.json, gs5_oneplusone_dsthink_bare.json (loops: results/gepa/gepa_result_gs5_*.json)

modelfloorNwins [95 % CI] · tower: highest floorHP / optdiedconfiguration
result file (raw JSON)gepa_result_gs5_oneplusone_dsthink_bare
result file (raw JSON)gepa_result_gs5_pareto_dsthink_bare
prompt-optimisation result (see Prompt optimisation)gs5_oneplusone_dsthink_bare
prompt-optimisation result (see Prompt optimisation)gs5_pareto_dsthink_bare
Section 6.5.4, evolved-route prompt

Files: loop results/gepa/gepa_result_evolved_route_complex_deepseek.json; evaluation complex_evolved_route_deepseek-v4-flash

modelfloorNwins [95 % CI] · tower: highest floorHP / optdiedconfiguration
DeepSeek-V4-FlashComplex floor50/5 [0.00, 0.43]–0evolved_route
result file (raw JSON)gepa_result_evolved_route_complex_deepseek

6.6 Planning horizon (RQ3)

Section 6.6 in the thesis
Tables 6.9 and 6.10 and Figure 6.4, single floors

Files: simple_<m>_final2_plan<k>, …_planf (long plan, whole-floor wording, re-planned), …_oneshot_plan (single call, whole-floor wording), …_maxsteps, …_maxsteps_once; reactive arms simple_qwen3.5-397b_final2_la3, simple_deepseek-v4-flash_final2_reactive and …_reactive_t32, complex_deepseek-v4-flash_survival_final2_reactive and …_reactive_t32, hand0<i>_deepseek-v4-flash_final2 and …_reactive_t32, simple_qwen3.8-27b_final2_reactive_t32_t06, complex_qwen3.8-27b_survival_final2_reactive_t32_t06; committed modes complex_deepseek-v4-flash_survival_final2_*; hand0<i>_deepseek-v4-flash_final2_plan<k>, …_maxsteps; Qwen3.8-27B: simple_qwen3.8-27b_final2_*_t06, complex_qwen3.8-27b_survival_final2_*_t06

modelfloorNwins [95 % CI] · tower: highest floorHP / optdiedconfiguration
Simple floor
Qwen3.5-397BSimple floor1010/10 [0.72, 1.00]15%0final2_la3
DeepSeek-V4-FlashSimple floor50/5 [0.00, 0.43]–0final2_maxsteps
Qwen3.5-397BSimple floor50/5 [0.00, 0.43]–0final2_maxsteps
DeepSeek-V4-FlashSimple floor50/5 [0.00, 0.43]–0final2_maxsteps_once
Qwen3.5-397BSimple floor50/5 [0.00, 0.43]–0final2_maxsteps_once
Qwen3.8-27BSimple floor30/3 [0.00, 0.56]–0final2_maxsteps_once_t06
Qwen3.8-27BSimple floor30/3 [0.00, 0.56]–0final2_maxsteps_t06
DeepSeek-V4-FlashSimple floor50/5 [0.00, 0.43]–0final2_oneshot_plan
Qwen3.5-397BSimple floor50/5 [0.00, 0.43]–0final2_oneshot_plan
Qwen3.8-27BSimple floor30/3 [0.00, 0.56]–0final2_oneshot_plan
DeepSeek-V4-FlashSimple floor50/5 [0.00, 0.43]–0final2_plan2
Qwen3.5-397BSimple floor51/5 [0.04, 0.62]15%0final2_plan2
Qwen3.8-27BSimple floor32/3 [0.21, 0.94]15%0final2_plan2_t06
DeepSeek-V4-FlashSimple floor50/5 [0.00, 0.43]–0final2_plan3
Qwen3.5-397BSimple floor50/5 [0.00, 0.43]–0final2_plan3
Qwen3.8-27BSimple floor30/3 [0.00, 0.56]–0final2_plan3_t06
DeepSeek-V4-FlashSimple floor50/5 [0.00, 0.43]–0final2_plan5
Qwen3.5-397BSimple floor50/5 [0.00, 0.43]–0final2_plan5
Qwen3.8-27BSimple floor31/3 [0.06, 0.79]77%0final2_plan5_t06
DeepSeek-V4-FlashSimple floor50/5 [0.00, 0.43]–0final2_planf
Qwen3.5-397BSimple floor50/5 [0.00, 0.43]–0final2_planf
DeepSeek-V4-FlashSimple floor53/5 [0.23, 0.88]15%0final2_reactive
DeepSeek-V4-FlashSimple floor51/5 [0.04, 0.62]15%0final2_reactive_t32
Qwen3.8-27BSimple floor33/3 [0.44, 1.00]15%0final2_reactive_t32_t06
Complex floor
DeepSeek-V4-FlashComplex floor55/5 [0.57, 1.00]32%0survival_final2_maxsteps
DeepSeek-V4-FlashComplex floor50/5 [0.00, 0.43]–0survival_final2_maxsteps_once
Qwen3.8-27BComplex floor30/3 [0.00, 0.56]–0survival_final2_maxsteps_once_t06
Qwen3.8-27BComplex floor33/3 [0.44, 1.00]32%0survival_final2_maxsteps_t06
DeepSeek-V4-FlashComplex floor50/5 [0.00, 0.43]–0survival_final2_oneshot_plan
DeepSeek-V4-FlashComplex floor53/5 [0.23, 0.88]32%0survival_final2_plan2
Qwen3.8-27BComplex floor33/3 [0.44, 1.00]32%0survival_final2_plan2_t06
DeepSeek-V4-FlashComplex floor53/5 [0.23, 0.88]26%0survival_final2_plan3
Qwen3.8-27BComplex floor33/3 [0.44, 1.00]32%0survival_final2_plan3_t06
DeepSeek-V4-FlashComplex floor54/5 [0.38, 0.96]26%0survival_final2_plan5
DeepSeek-V4-FlashComplex floor54/5 [0.38, 0.96]28%0survival_final2_plan5_t06
Qwen3.8-27BComplex floor33/3 [0.44, 1.00]32%0survival_final2_plan5_t06
DeepSeek-V4-FlashComplex floor54/5 [0.38, 0.96]26%0survival_final2_planf
DeepSeek-V4-FlashComplex floor53/5 [0.23, 0.88]24%0survival_final2_reactive
DeepSeek-V4-FlashComplex floor108/10 [0.49, 0.94]23%0survival_final2_reactive_t32
DeepSeek-V4-FlashComplex floor108/10 [0.49, 0.94]26%1survival_final2_reactive_t32_t06
Qwen3.8-27BComplex floor33/3 [0.44, 1.00]32%0survival_final2_reactive_t32_t06
DeepSeek-V4-FlashComplex floor52/5 [0.12, 0.77]24%0survival_final2_reactive_t32_t10
hand01
DeepSeek-V4-Flashhand0154/5 [0.38, 0.96]68%0final2
DeepSeek-V4-Flashhand0150/5 [0.00, 0.43]–0final2_maxsteps
DeepSeek-V4-Flashhand0150/5 [0.00, 0.43]–0final2_plan3
DeepSeek-V4-Flashhand0150/5 [0.00, 0.43]–0final2_plan5
DeepSeek-V4-Flashhand0155/5 [0.57, 1.00]66%0final2_reactive_t32
hand02
DeepSeek-V4-Flashhand0255/5 [0.57, 1.00]31%0final2
DeepSeek-V4-Flashhand0250/5 [0.00, 0.43]–0final2_maxsteps
DeepSeek-V4-Flashhand0250/5 [0.00, 0.43]–0final2_plan3
DeepSeek-V4-Flashhand0250/5 [0.00, 0.43]–0final2_plan5
DeepSeek-V4-Flashhand0254/5 [0.38, 0.96]29%0final2_reactive_t32
hand03
DeepSeek-V4-Flashhand0350/5 [0.00, 0.43]–0final2
hand04
DeepSeek-V4-Flashhand0450/5 [0.00, 0.43]–0final2
Table 6.9, tower row (second tower observation)

Files: tower_deepseek-v4-flash_final3_reactive, …_plan<k>, …_maxsteps, …_maxsteps_once

modelfloorNwins [95 % CI] · tower: highest floorHP / optdiedconfiguration
DeepSeek-V4-FlashTower MT0→MT23w1MT8–0final3_maxsteps
DeepSeek-V4-FlashTower MT0→MT23w1MT3–0final3_maxsteps_once
DeepSeek-V4-FlashTower MT0→MT23w1MT8–0final3_plan2
DeepSeek-V4-FlashTower MT0→MT23w1MT8–0final3_plan3
DeepSeek-V4-FlashTower MT0→MT23w1MT8–0final3_plan5
DeepSeek-V4-FlashTower MT0→MT23w3MT8, MT8, MT8–0final3_reactive
Section 6.6, exact route

Files: complex_<m>_exact68_final2

modelfloorNwins [95 % CI] · tower: highest floorHP / optdiedconfiguration
DeepSeek-V4-FlashComplex floor51/5 [0.04, 0.62]59%0exact68_final2
Qwen3.6-35BComplex floor52/5 [0.12, 0.77]85%1exact68_final2

6.7 Hand-designed floors, generated floors and the tower

Section 6.7 in the thesis
Table 6.11, hand-designed floors

Files: hand0<i>_<m>_canon

modelfloorNwins [95 % CI] · tower: highest floorHP / optdiedconfiguration
hand01
DeepSeek-V4-Flashhand0154/5 [0.38, 0.96]66%0canon
Mistral-Medium-3.5hand0155/5 [0.57, 1.00]64%0canon
Qwen3.5-397Bhand0155/5 [0.57, 1.00]50%0canon
Qwen3.6-35Bhand0154/5 [0.38, 0.96]64%0canon
hand02
DeepSeek-V4-Flashhand0255/5 [0.57, 1.00]28%0canon
Mistral-Medium-3.5hand0255/5 [0.57, 1.00]86%0canon
Qwen3.5-397Bhand0254/5 [0.38, 0.96]48%0canon
Qwen3.6-35Bhand0253/5 [0.23, 0.88]31%0canon
hand03
DeepSeek-V4-Flashhand0350/5 [0.00, 0.43]–0canon
Mistral-Medium-3.5hand0350/5 [0.00, 0.43]–0canon
Qwen3.5-397Bhand0350/5 [0.00, 0.43]–0canon
Qwen3.6-35Bhand0350/5 [0.00, 0.43]–0canon
hand04
DeepSeek-V4-Flashhand0450/5 [0.00, 0.43]–0canon
Mistral-Medium-3.5hand0450/5 [0.00, 0.43]–0canon
Qwen3.5-397Bhand0450/5 [0.00, 0.43]–0canon
Qwen3.6-35Bhand0450/5 [0.00, 0.43]–0canon
Table 6.12, generated floors

Files: gen0<i>_qwen3.5-397b_final2 (gen01 to gen03), gen<i>_deepseek-v4-flash_final2 (gen03 to gen15); pooled counts from all files that name the floor, except gs3_dsbare_confirm

modelfloorNwins [95 % CI] · tower: highest floorHP / optdiedconfiguration
gen01
Qwen3.5-397Bgen0133/3 [0.44, 1.00]100%0final2
gen02
Qwen3.5-397Bgen0233/3 [0.44, 1.00]100%0final2
gen03
DeepSeek-V4-Flashgen0332/3 [0.21, 0.94]100%0final2
Qwen3.5-397Bgen0311/1 [0.21, 1.00]100%0final2
gen04
DeepSeek-V4-Flashgen0433/3 [0.44, 1.00]100%0final2
gen05
DeepSeek-V4-Flashgen0533/3 [0.44, 1.00]99%0final2
gen06
DeepSeek-V4-Flashgen0633/3 [0.44, 1.00]100%0final2
gen07
DeepSeek-V4-Flashgen0733/3 [0.44, 1.00]98%0final2
gen08
DeepSeek-V4-Flashgen0833/3 [0.44, 1.00]97%0final2
gen09
DeepSeek-V4-Flashgen0933/3 [0.44, 1.00]90%0final2
gen10
DeepSeek-V4-Flashgen1032/3 [0.21, 0.94]86%0final2
gen11
DeepSeek-V4-Flashgen1130/3 [0.00, 0.56]–0final2
gen12
DeepSeek-V4-Flashgen1230/3 [0.00, 0.56]–0final2
gen13
DeepSeek-V4-Flashgen1333/3 [0.44, 1.00]95%0final2
gen14
DeepSeek-V4-Flashgen1433/3 [0.44, 1.00]96%0final2
gen15
DeepSeek-V4-Flashgen1533/3 [0.44, 1.00]98%0final2
prompt-optimisation result (see Prompt optimisation)gs3_dsbare_confirm
Table 6.13, tower

Files: tower_<m>_<label>_reactive with the labels of Table D.5 (Qwen3.5-397B, first observation: tower_qwen3.5-397b_final2); continuations from MT18 tower_<m>_final11_resume_blue; heuristic tower_MT0-MT23w_heuristic_final3, with the game's item values tower_MT0-MT23w_heuristic_final7

modelfloorNwins [95 % CI] · tower: highest floorHP / optdiedconfiguration
DeepSeek-V4-FlashTower MT0→MT23w3MT17, MT8, MT17–0final11_reactive
Mistral-Medium-3.5Tower MT0→MT23w3MT8, MT4, MT4–0final11_reactive
Qwen3.5-397BTower MT0→MT23w3MT18, MT8, MT8–0final11_reactive
Qwen3.6-35BTower MT0→MT23w3MT8, MT8, MT16–0final11_reactive
DeepSeek-V4-FlashTower MT0→MT23w3MT20, MT21, MT21–0final11_resume_blue
Qwen3.5-397BTower MT0→MT23w1MT21–0final11_resume_blue
Qwen3.5-397BTower MT0→MT23w1MT7–0final2
DeepSeek-V4-FlashTower MT0→MT23w5MT7, MT7, MT3, MT7, MT7–0final2_reactive
heuristicTower MT0→MT23w1MT8–0final3
DeepSeek-V4-FlashTower MT0→MT23w3MT8, MT8, MT8–0final3_reactive
Qwen3.5-397BTower MT0→MT23w1MT8–0final3_reactive
heuristicTower MT0→MT23w1MT8–0final7

Figures

Figures 6.1 to 6.4

Files: plotted by scripts/thesis_figures.py from the files of Table 6.5 (Figure 6.1), the value traces (6.2), gs3_dsbare_confirm.json (6.3) and the planning files (6.4)

modelfloorNwins [95 % CI] · tower: highest floorHP / optdiedconfiguration
prompt-optimisation result (see Prompt optimisation)gs3_dsbare_confirm
Further cells not cited by the thesis (128)

Development runs, earlier versions of a configuration and pilots, listed for completeness; the thesis does not report them.

show the list
modelfloorNwins [95 % CI] · tower: highest floorHP / optdiedconfiguration
Simple floor
Qwen3.5-397BSimple floor51/5 [0.04, 0.62]15%0basic
GLM-5.3-FlashSimple floor55/5 [0.57, 1.00]15%0basic_d1d4
Qwen3.5-397BSimple floor109/10 [0.60, 0.98]15%0basic_k1k2_hist0_compact
Qwen3.5-397BSimple floor50/5 [0.00, 0.43]–0basic_k1k2_la0
Qwen3.5-397BSimple floor50/5 [0.00, 0.43]–0basic_k1k2_la1
Qwen3.5-397BSimple floor107/10 [0.40, 0.89]15%0basic_k1k2_la2
Qwen3.5-397BSimple floor50/5 [0.00, 0.43]–3basic_multistep5
Qwen3.5-397BSimple floor30/3 [0.00, 0.56]–3basic_multistep5_d1d4
Qwen3.5-397BSimple floor50/5 [0.00, 0.43]–0basic_oneshot
GLM-5.3-FlashSimple floor55/5 [0.57, 1.00]15%0basic_order_aware
Qwen3.5-397BSimple floor50/5 [0.00, 0.43]–0basic_order_aware_la1
Qwen3.5-397BSimple floor50/5 [0.00, 0.43]–0basic_order_aware_la2
Qwen3.5-397BSimple floor50/5 [0.00, 0.43]–0basic_v2
DeepSeek-V4-FlashSimple floor51/5 [0.04, 0.62]31%0blockergraph
DeepSeek-V4-FlashSimple floor52/5 [0.12, 0.77]15%0effnet_t32
GLM-5.3-FlashSimple floor20/2 [0.00, 0.66]–0final2_la3
Qwen3.8-27BSimple floor33/3 [0.44, 1.00]15%0final2_reactive
Qwen3.5-397BSimple floor20/2 [0.00, 0.66]–0mapgraph
Qwen3.6-35BSimple floor20/2 [0.00, 0.66]–0plan3_trial
heuristicSimple floor10/1 [0.00, 0.79]–0reactive
Qwen3.5-397BSimple floor50/5 [0.00, 0.43]–0reactive
Qwen3.6-35BSimple floor50/5 [0.00, 0.43]–0reactive
Qwen3.8-27BSimple floor54/5 [0.38, 0.96]15%0reactive
Qwen3.5-397BSimple floor50/5 [0.00, 0.43]–0reactive_la2
Qwen3.6-35BSimple floor50/5 [0.00, 0.43]–0reactive_la2
Qwen3.8-27BSimple floor30/3 [0.00, 0.56]–0reactive_la2
Qwen3.5-397BSimple floor50/5 [0.00, 0.43]–0reactive_raw
DeepSeek-V4-FlashSimple floor30/3 [0.00, 0.56]–0selflookahead
Complex floor
GLM-5.3-FlashComplex floor30/3 [0.00, 0.56]–3basic_d1d4
Qwen3.5-397BComplex floor50/5 [0.00, 0.43]–5basic_d1d4
Qwen3.5-397BComplex floor50/5 [0.00, 0.43]–5basic_k1k2
Qwen3.5-397BComplex floor50/5 [0.00, 0.43]–0basic_k1k2_hist0
Qwen3.5-397BComplex floor50/5 [0.00, 0.43]–5basic_order_aware
DeepSeek-V4-FlashComplex floor50/5 [0.00, 0.43]–0effnet_la3
DeepSeek-V4-FlashComplex floor50/5 [0.00, 0.43]–0final2_la3
GLM-5.3-FlashComplex floor40/4 [0.00, 0.49]–0final2_la3
Qwen3.5-397BComplex floor50/5 [0.00, 0.43]–0final2_la3
Qwen3.6-35BComplex floor50/5 [0.00, 0.43]–0final2_la3
DeepSeek-V4-FlashComplex floor50/5 [0.00, 0.43]–0final2_la3_t06
Qwen3.5-397BComplex floor50/5 [0.00, 0.43]–0final2_la3_t06
DeepSeek-V4-FlashComplex floor50/5 [0.00, 0.43]–0final2_la3_t10
heuristicComplex floor10/1 [0.00, 0.79]–0reactive
Qwen3.5-397BComplex floor52/5 [0.12, 0.77]100%3reactive_raw
Qwen3.6-35BComplex floor50/5 [0.00, 0.43]–5reactive_raw
Qwen3.8-27BComplex floor51/5 [0.04, 0.62]100%4reactive_raw
Qwen3.5-397BComplex floor52/5 [0.12, 0.77]100%3reactive_raw_la2
Qwen3.6-35BComplex floor50/5 [0.00, 0.43]–5reactive_raw_la2
Qwen3.8-27BComplex floor50/5 [0.00, 0.43]–5reactive_raw_la2
Qwen3.6-35BComplex floor50/5 [0.00, 0.43]–5reactive_raw_mechanical
Qwen3.6-35BComplex floor54/5 [0.38, 0.96]49%1reactive_raw_survival
Qwen3.5-397BComplex floor55/5 [0.57, 1.00]26%0survival_final2_reactive
Qwen3.6-35BComplex floor55/5 [0.57, 1.00]32%0survival_final2_reactive
Qwen3.5-397BComplex floor52/5 [0.12, 0.77]95%3survival_hints_on
Qwen3.6-35BComplex floor54/5 [0.38, 0.96]41%1survival_hints_on
Qwen3.6-35BComplex floor51/5 [0.04, 0.62]100%4survival_order_aware
hand01
DeepSeek-V4-Flashhand0151/5 [0.04, 0.62]71%0blockergraph
Qwen3.5-397Bhand0155/5 [0.57, 1.00]43%0final2
Qwen3.6-35Bhand0133/3 [0.44, 1.00]64%0final2
DeepSeek-V4-Flashhand0150/5 [0.00, 0.43]–0selflookahead
Qwen3.5-397Bhand0121/2 [0.09, 0.91]64%0trial_v1
Qwen3.6-35Bhand0122/2 [0.34, 1.00]64%0trial_v1
hand02
Qwen3.5-397Bhand0253/5 [0.23, 0.88]54%0final2
Qwen3.6-35Bhand0233/3 [0.44, 1.00]31%0final2
Qwen3.6-35Bhand0222/2 [0.34, 1.00]31%0trial_v1
hand03
Qwen3.5-397Bhand0350/5 [0.00, 0.43]–0final2
Qwen3.6-35Bhand0330/3 [0.00, 0.56]–0final2
Qwen3.6-35Bhand0320/2 [0.00, 0.66]–0trial_v1
hand04
Qwen3.5-397Bhand0450/5 [0.00, 0.43]–0final2
Qwen3.6-35Bhand0430/3 [0.00, 0.56]–0final2
Qwen3.6-35Bhand0420/2 [0.00, 0.66]–0trial_v1
Tower MT0→MT23w
Qwen3.5-397BTower MT0→MT23w1MT8–0basic
Qwen3.5-397BTower MT0→MT23w1?–0basic_d1d4
Qwen3.5-397BTower MT0→MT23w1MT3–1basic_k1k2
Qwen3.5-397BTower MT0→MT23w1MT3–0basic_mechanical
Qwen3.5-397BTower MT0→MT23w1MT4–0basic_s2hp
DeepSeek-V4-FlashTower MT0→MT23w3MT16, MT8, MT8–0final10_reactive
Mistral-Medium-3.5Tower MT0→MT23w3MT4, MT4, MT8–0final10_reactive
Qwen3.5-397BTower MT0→MT23w3MT21, MT8, MT8–0final10_reactive
Qwen3.6-35BTower MT0→MT23w3MT8, MT8, MT16–0final10_reactive
Qwen3.5-397BTower MT0→MT23w1MT18–0final10_resume
DeepSeek-V4-FlashTower MT0→MT23w3MT3, MT4, MT3–0final2_maxsteps
DeepSeek-V4-FlashTower MT0→MT23w3MT3, MT3, MT3–0final2_maxsteps_once
DeepSeek-V4-FlashTower MT0→MT23w1MT7–0final2_plan2
DeepSeek-V4-FlashTower MT0→MT23w1MT7–0final2_plan3
DeepSeek-V4-FlashTower MT0→MT23w1MT7–0final2_plan5
DeepSeek-V4-FlashTower MT0→MT23w1MT7–0final2_planf
DeepSeek-V4-FlashTower MT0→MT23w1MT7–0final2_reactive_t16_t06
DeepSeek-V4-FlashTower MT0→MT23w1MT3–0final2_shoproute_remote
Qwen3.5-397BTower MT0→MT23w3MT8, MT14, MT8–0final4_nohp_reactive
DeepSeek-V4-FlashTower MT0→MT23w3MT14, MT14, MT8–0final4_reactive
Qwen3.5-397BTower MT0→MT23w3MT3, MT3, MT8–0final4_reactive
DeepSeek-V4-FlashTower MT0→MT23w1MT8–0final5_effnet
Qwen3.5-397BTower MT0→MT23w3MT8, MT8, MT8–0final5_nohp_reactive
DeepSeek-V4-FlashTower MT0→MT23w3MT8, MT14, MT14–0final5_reactive
Qwen3.5-397BTower MT0→MT23w2MT8, MT8–0final5_reactive
heuristicTower MT0→MT23w1MT8–0final6
DeepSeek-V4-FlashTower MT0→MT23w2MT8, MT8–0final6_reactive
Qwen3.5-397BTower MT0→MT23w1MT8–0final6_reactive_beforeplanmemory
DeepSeek-V4-FlashTower MT0→MT23w3MT8, MT16, MT4–0final7_plan3
Qwen3.5-397BTower MT0→MT23w3MT8, MT8, MT8–0final7_plan3
DeepSeek-V4-FlashTower MT0→MT23w3MT3, MT8, MT3–0final7_plan5
DeepSeek-V4-FlashTower MT0→MT23w3MT3, MT14, MT14–0final7_reactive
Qwen3.5-397BTower MT0→MT23w2MT14, MT7–0final7_reactive
DeepSeek-V4-FlashTower MT0→MT23w3MT14, MT16, MT3–0final8_reactive
Qwen3.5-397BTower MT0→MT23w1MT7–0final8_reactive
DeepSeek-V4-FlashTower MT0→MT23w2MT8, MT16–0final9_noplanmem
DeepSeek-V4-FlashTower MT0→MT23w3MT16, MT16, MT16–0final9_reactive
Tower MT0→MT5
heuristicTower MT0→MT51MT5–0segment0
Tower MT0→MT23w
heuristicTower MT0→MT23w1MT7–0tower_MT0-MT23w_heuristic
Qwen3.6-35BTower MT0→MT23w1MT14–1tower_seed
heuristicTower MT0→MT23w1MT8–0v2
MT3
Qwen3.5-397BMT355/5 [0.57, 1.00]84%0basic_order_aware
heuristicMT311/1 [0.21, 1.00]100%0reactive
Tower MT3→MT4
Qwen3.5-397BTower MT3→MT45MT4, MT4, MT4, MT4, MT4–0basic_d1d4
MT4
Qwen3.5-397BMT450/5 [0.00, 0.43]–5basic_order_aware
heuristicMT410/1 [0.00, 0.79]–0reactive
Tower MT4→MT13
heuristicTower MT4→MT131MT13–0segment3
Tower MT5→MT8
heuristicTower MT5→MT81MT8–0segment1
Qwen3.5-397BTower MT5→MT81MT8–0segment1_basic_d1d4
Qwen3.5-397BTower MT5→MT82MT7, MT7–2segment1_basic_k1k2
Qwen3.5-397BTower MT5→MT82MT7, MT8–0segment1_basic_s2hp
Qwen3.5-397BTower MT5→MT82MT7, MT7–0segment1_final2
Tower MT7→MT13
heuristicTower MT7→MT131MT13–0segment4
Tower MT8→MT11
heuristicTower MT8→MT111MT8–0segment2
Qwen3.5-397BTower MT8→MT112MT8, MT8–0segment2_basic_d1d4
Tower MT12→MT19
heuristicTower MT12→MT191MT14–0segment6
Tower MT13→MT16
heuristicTower MT13→MT161MT14–0segment5
Tower MT19→MT23w
heuristicTower MT19→MT23w1MT21–0segment7