1
One big transfer
2
Streamed
Loop
Pause
gradients
optimizer update
updated weights