One-round asynchronous prod RL
Score centering · top-p 0.95 · top-k 20 · three random seeds each
Synchronous
One-round asynchronous
0.2
0.3
0.4
0.5
0.6
0.7
0
48
96
144
Optimizer steps
Reward