Nomenclature

Abbreviations

AbbreviationFull form
AIArtificial Intelligence
APEAutomatic Prompt Engineer
APIApplication Programming Interface
APOAutomatic Prompt Optimisation
ASCIIAmerican Standard Code for Information Interchange
ATKAttack (hero or monster attribute)
BFSBreadth-First Search
CoTChain of Thought
DEFDefence (hero or monster attribute)
DSPyDeclarative Self-improving Python (prompt-programming framework)
EXPExperience points
GEPAGenetic-Pareto prompt optimisation
GRPOGroup Relative Policy Optimization
GWDGGesellschaft für wissenschaftliche Datenverarbeitung mbH Göttingen
HPHit points
HTMLHyperText Markup Language
JSONJavaScript Object Notation
LLMLarge Language Model
MDEFMagic defence (hero attribute subtracted from every fight's damage)
MoEMixture of Experts
MT0–MT23Floors 0 to 23 of the 24-floor tower
OPROOptimization by PROmpting
RLReinforcement Learning
RLHFReinforcement Learning from Human Feedback
RQResearch Question
SAIAScalable AI Accelerator (inference service of the GWDG)
STRIPSStanford Research Institute Problem Solver

Symbols

Game, engine and solver

SymbolMeaning
aha_h, dhd_hthe hero's ATK and DEF
hmh_m, ama_m, dmd_ma monster's HP, ATK and DEF
TTnumber of hero strikes needed to defeat a monster
dda monster's damage per strike after the hero's DEF (Table 4.1)
DDHP cost of a fight
(S,s0,A,δ,G)(S, s_0, A, \delta, G)floor task: set of states, initial state, legal actions A(s)A(s), transition, goal (Definition 4.1)
HPfinal_{\text{final}}the hero's HP at the end of an episode
HPopt_{\text{opt}}exact optimum of a floor: the largest final HP of any winning action sequence
LLnet lookahead value of an action
viv_iHP-equivalent value of an unlocked item ii
λj\lambda_jfactor for items behind jj gateways (1 for j=0j = 0; 0.7, 0.5 and 0.35 for j=1,2,3j = 1, 2, 3)
cgc_gHP cost of gateway gg
CrouteC_{\text{route}}, SrouteS_{\text{route}}HP of fighting needed to reach the stat items behind an action, and the HP these items save on the other listed fights (net stat-route line)

Measures

SymbolMeaning
NNnumber of episodes of a configuration
kkcommitment: number of actions per model call; in k/Nk/N, the number of successful episodes
p^\hat psuccess rate k/Nk/N
zzquantile of the standard normal distribution in the Wilson interval (z=1.96z = 1.96)
HP/optHPfinal_{\text{final}} divided by HPopt_{\text{opt}} for a successful episode; reported as the mean over successful episodes
SgoalS_{\text{goal}}goal score of one episode
CCshare of a floor's monsters defeated (in SgoalS_{\text{goal}})
nn, bbin the sign test: number of discordant pairs, and the number of these that favour the first prompt (in Chapter 2, a sequence length and a branching factor)

General symbols (Chapter 2)

SymbolMeaning
wtw_tthe tt-th token of a sequence of nn tokens
Pr⁡(⋅)\Pr(\cdot)probability
QQ, KK, VVquery, key and value matrices of self-attention
dkd_klength of the key vectors
ziz_iscore of token ii in the model's last layer
pip_iprobability of token ii after the softmax
τ\tausampling temperature
θ\thetaparameters of a model
PPprompt
ss, aastate, action
π(a∣s,P)\pi(a \mid s, P)policy: probability of action aa in state ss under prompt PP
GGnumber of outputs sampled per input in GRPO (the goal of a floor task in Definition 4.1)
rir_ireward of output ii
A^i\hat{A}_iadvantage of output ii in GRPO: its reward standardised within its group
bbbranching factor: number of choices per step of a search
ℓ\ellsearch depth: number of actions from the initial state

Models

Models are named by family, version and total size; the endpoint identifiers are listed in Table 6.1 and Appendix D.

NameType and sizeReasoning modeUsed in
Qwen3.5-397Bmixture of experts, 397 B parameters, 17 B activethinkingmain experiments; planning study (Section 6.6); reference and teacher in the first configuration of the first prompt-optimisation study
Qwen3.6-35Bmixture of experts, 35 B parameters, 3 B activethinkingmain experiments; prompt-optimisation study (Section 6.5); exact-route prompt (Section 6.6)
Qwen3.8-27Bdense, 27 B parametersthinkingplanning study (Section 6.6)
DeepSeek-V4-Flashmixture of experts, 284 B parameters, 13 B activethinkingmain experiments; planning study (Section 6.6); teacher in the second configuration of the first prompt-optimisation study, task model and teacher in Sections 6.5.3 and 6.5.4
DeepSeek-V4-Flash (no thinking)the same model with its reasoning mode switched offnoneprompt-optimisation study (Section 6.5)
Mistral Medium 3.5128 B parameters, architecture not stated by the servicenonemain experiments
Llama-3.1-8Bdense, 8 B parameters, instruction-tunednoneprompt-optimisation study (Section 6.5)

B = billion.

Labels

LabelMeaning
RQ1–RQ3research questions (Section 1.1)
HA–HChypotheses of the thesis, one per research question (Section 1.1)
R1–R3rival explanations (Sections 1.1 and 7.2)
S1–S14strategy principles (Table 4.2)
G1–G5hypotheses of the prompt-optimisation study, stated before the runs (Section 6.5.1)
P1–P3predictions for the evolved-route run, stated before the run (Section 6.5.4)
hand01–hand04hand-designed floors (Table 4.3)
gen01–gen15generated floors (Table 4.3)
First, second and final tower observationthe three tower observations compared in Table 6.13 (Section 5.5.3); the final one is used for all tower results of Table 6.2

Internal Labels

Two labels of the verbatim observation text appear in listings and appendices:

Internal labelName in this thesis
effCosteffective cost
ORDER linefight-order line

The result file behind each reported cell is listed in Table D.4 (Appendix D).