Preserving deployment tokens is necessary in prod RL
1 weight update per redeployment ยท batch size 64
Retokenized text
Recorded tokens
0.0
0.1
0.2
0.3
0.4
0
2
4
6
8
10
12
14
Optimizer steps
Mean reward