A Sliced Wasserstein Loss for Neural Texture Synthesis

Eric Heitz
Unity Technologies
Kenneth Vanhoey
Unity Technologies
Thomas Chambon
Unity Technologies
Laurent Belcour
Unity Technologies

Published in CVPR 2021

article video poster code

Abstract. We address the problem of computing a textural loss based on the statistics extracted from the feature activations of a convolutional neural network optimized for object recognition (e.g. VGG-19). The underlying mathematical problem is the measure of the distance between two distributions in feature space. The Gram-matrix loss is the ubiquitous approximation for this problem but it is subject to several shortcomings. Our goal is to promote the Sliced Wasserstein Distance as a replacement for it. It is theoretically proven, practical, simple to implement, and achieves results that are visually superior for texture synthesis by optimization or training generative neural networks.