Quantization after SFT and RL
Neither SFT checkpoint showed a clear NVFP4 penalty
MXFP8
NVFP4
No change
Quantization after SFT and RL
−0.08
−0.06
−0.04
−0.02
0.00
+0.02
+0.04
+0.06
+0.08
MXFP8
NVFP4
Original model
+0.014
+0.024
RL · GRPO
+0.015
+0.034
SFT · LR 5×10⁻⁶
−0.002
−0.006
SFT · LR 5×10⁻⁵
−0.038
−0.015
Reward loss from quantization (BF16 minus quantized)