In plain words: A simple gradient trick that repeatedly trims the search back to the allowed input range runs an image generator's process backwards to find the exact starting code. Unlike the usual trial-and-error nudging, it recovered that code every time on images the generator produced.
Abstract · Precise Recovery of Latent Vectors from Generative Adversarial Networks
Generative adversarial networks (GANs) transform latent vectors into visually plausible images. It is generally thought that the original GAN formulation gives no out-of-the-box method to reverse the mapping, projecting images back into latent space. We introduce a simple, gradient-based technique called stochastic clipping. In experiments, for images generated by the GAN, we precisely recover their latent vector pre-images 100% of the time. Additional experiments demonstrate that this method is robust to noise. Finally, we show that even for unseen images, our method appears to recover unique encodings.
Zachary C. Lipton, Subarna Tripathi
arXiv:1702.04782 · cs.LG, cs.NE, stat.ML · submitted Feb 15, 2017 · updated Feb 17, 2017
abstract · pdf · html