We will introduce sparse factorization layers: neural network layers that perform dictionary learning. These layers are trained with standard end-to-end gradient-based learning.