Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift

Abstract

This paper introduces and evaluates the idea described in “Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift”, and reports empirical results that helped shape subsequent work in optimization, training.