The whole model runs on the GPU with f16 weights, and its per-layer keys and
values are compared against the ones ONNX Runtime produced in fp32
(golden/reference/). Phase 1 established that the CPU reference agrees with that
oracle to 9.1e-5 relative per layer; whatever this run adds on top is what f16 storage costs
end to end, through 24 layers.