Quantization after SFT and RL

Neither SFT checkpoint showed a clear NVFP4 penalty

MXFP8NVFP4No change
Quantization after SFT and RL−0.08−0.06−0.04−0.020.00+0.02+0.04+0.06+0.08MXFP8NVFP4Original model+0.014+0.024RL · GRPO+0.015+0.034SFT · LR 5×10⁻⁶−0.002−0.006SFT · LR 5×10⁻⁵−0.038−0.015Reward loss from quantization (BF16 minus quantized)