about
Fast Face-Swap Using Convolutional Neural Networks (arxiv.org)
2 points by maheshkkumar on Nov 30, 2016 | hide | past | pdf | discuss on HN

In plain words: It treats face-swapping like style transfer: a network learns one person's look from a jumble of their photos, then redraws another face in that look while keeping pose, expression, and lighting. The result looks like a real photo and runs in real time with no user input.

Abstract · Fast Face-swap Using Convolutional Neural Networks

We consider the problem of face swapping in images, where an input identity is transformed into a target identity while preserving pose, facial expression, and lighting. To perform this mapping, we use convolutional neural networks trained to capture the appearance of the target identity from an unstructured collection of his/her photographs.This approach is enabled by framing the face swapping problem in terms of style transfer, where the goal is to render an image in the style of another one. Building on recent advances in this area, we devise a new loss function that enables the network to produce highly photorealistic results. By combining neural networks with simple pre- and post-processing steps, we aim at making face swap work in real-time with no input from the user.

Iryna Korshunova, Wenzhe Shi, Joni Dambre, Lucas Theis
arXiv:1611.09577 · cs.CV · submitted Nov 29, 2016 · updated Jul 27, 2017
abstract · pdf · html

add comment on HN