Prod RL with reference model IS ratios collapses
16 weight updates per redeployment · batch size 64 · three random seeds
0.0
0.1
0.2
0.3
0.4
0.5
0.6
0
48
96
144
192
240
288
Optimizer steps
Reward