Preserving deployment tokens is necessary in prod RL
16 weight updates per redeployment ยท batch size 64
Retokenized text
Recorded tokens
0.0
0.1
0.2
0.3
0.4
0
16
32
48
64
80
96
Optimizer steps
Mean reward