Score centering outperforms importance sampling
16 weight updates per redeployment · batch size 64 · three random seeds each
Importance sampling
Score centering
0.2
0.3
0.4
0.5
0.6
0.7
0
48
96
144
192
Optimizer steps
Reward