Properties Required by Network Layers for Normalizing Flows

 
  • the set of network layers must be sufficiently expressive to map a multivariate standard normal distribution to an arbitrary density
  • networks should be invertible
  • It must be possible to compute the inverse of each layer efficiently
  • It also must be possible to evaluate the determinant of the Jacobian efficiently for either the forward or inverse mapping.