In plain words: A generator takes a map of where objects go plus labels like day or foggy, and paints an outdoor scene to match. Unlike generators given object names or boxes, it draws realistic scenes with sharp object edges in day, night, sunny, or foggy conditions.
Abstract · Learning to Generate Images of Outdoor Scenes from Attributes and Semantic Layouts
Automatic image synthesis research has been rapidly growing with deep networks getting more and more expressive. In the last couple of years, we have observed images of digits, indoor scenes, birds, chairs, etc. being automatically generated. The expressive power of image generators have also been enhanced by introducing several forms of conditioning variables such as object names, sentences, bounding box and key-point locations. In this work, we propose a novel deep conditional generative adversarial network architecture that takes its strength from the semantic layout and scene attributes integrated as conditioning variables. We show that our architecture is able to generate realistic outdoor scene images under different conditions, e.g. day-night, sunny-foggy, with clear object boundaries.
Levent Karacan, Zeynep Akata, Aykut Erdem, Erkut Erdem
arXiv:1612.00215 · cs.CV · submitted Dec 1, 2016
abstract · pdf · html