about
Controlling Perceptual Factors in Neural Style Transfer (arxiv.org)
1 point by EvgeniyZh on Nov 24, 2016 | hide | past | pdf | discuss on HN

In plain words: Style transfer usually paints a whole photo with one look; this adds controls for where the style goes, its colors, and how fine it is. That keeps ground textures off the sky, mixes looks from several images, and makes big high-quality pictures faster.

Abstract

Neural Style Transfer has shown very exciting results enabling new forms of image manipulation. Here we extend the existing method to introduce control over spatial location, colour information and across spatial scale. We demonstrate how this enhances the method by allowing high-resolution controlled stylisation and helps to alleviate common failure cases such as applying ground textures to sky regions. Furthermore, by decomposing style into these perceptual factors we enable the combination of style information from multiple sources to generate new, perceptually appealing styles from existing ones. We also describe how these methods can be used to more efficiently produce large size, high-quality stylisation. Finally we show how the introduced control measures can be applied in recent methods for Fast Neural Style Transfer.

Leon A. Gatys, Alexander S. Ecker, Matthias Bethge, Aaron Hertzmann, Eli Shechtman
arXiv:1611.07865 · cs.CV · submitted Nov 23, 2016 · updated May 11, 2017
abstract · pdf · html · Accepted at CVPR2017

add comment on HN