Batch Normalization

$y=\frac{x-E[x]}{\sqrt{Var[x]+\epsilon}}*\gamma+\beta*$

Reference

• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
• PyTorch Documentation