about
A Generative Model of People in Clothing (arxiv.org)
2 points by stillmotion on May 15, 2017 | hide | past | pdf | discuss on HN

In plain words: It first draws a simple body-and-clothing outline, then paints a realistic photo on top of it, learning from ordinary pictures instead of 3D scans and graphics rendering. The result is entirely new full-body people in varied clothing, steerable by pose, shape, or color.

Abstract

We present the first image-based generative model of people in clothing for the full body. We sidestep the commonly used complex graphics rendering pipeline and the need for high-quality 3D scans of dressed people. Instead, we learn generative models from a large image database. The main challenge is to cope with the high variance in human pose, shape and appearance. For this reason, pure image-based approaches have not been considered so far. We show that this challenge can be overcome by splitting the generating process in two parts. First, we learn to generate a semantic segmentation of the body and clothing. Second, we learn a conditional model on the resulting segments that creates realistic images. The full model is differentiable and can be conditioned on pose, shape or color. The result are samples of people in different clothing items and styles. The proposed model can generate entirely new people with realistic clothing. In several experiments we present encouraging results that suggest an entirely data-driven approach to people generation is possible.

Christoph Lassner, Gerard Pons-Moll, Peter V. Gehler
arXiv:1705.04098 · cs.CV · submitted May 11, 2017 · updated Jul 31, 2017
abstract · pdf · html

add comment on HN