Identical token prefix Frozen teacherOriginal BF16 modelQuantizers disabledOriginal weights Training actorQDQ studentQuantized forwardHigh-precision backward Rollout engineNative FP4 studentUsed after trainingPreserved scales Sync weights Distillation lossTeacher ↔ training actor Backprop through actor Teacher probsStudent probsStudent probs