about
DeepFaceLab: Integrated, flexible and extensible face-swapping framework (arxiv.org)
3 points by doener on May 31, 2022 | hide | past | pdf | 1 comment on HN

In plain words: An all-in-one toolkit that walks users through every step of swapping one person's face onto another video, with each step easy to replace or upgrade. It produces cinema-quality, faithful swaps and outperforms other face-swapping tools.

Abstract

Deepfake defense not only requires the research of detection but also requires the efforts of generation methods. However, current deepfake methods suffer the effects of obscure workflow and poor performance. To solve this problem, we present DeepFaceLab, the current dominant deepfake framework for face-swapping. It provides the necessary tools as well as an easy-to-use way to conduct high-quality face-swapping. It also offers a flexible and loose coupling structure for people who need to strengthen their pipeline with other features without writing complicated boilerplate code. We detail the principles that drive the implementation of DeepFaceLab and introduce its pipeline, through which every aspect of the pipeline can be modified painlessly by users to achieve their customization purpose. It is noteworthy that DeepFaceLab could achieve cinema-quality results with high fidelity. We demonstrate the advantage of our system by comparing our approach with other face-swapping methods.For more information, please visit:https://github.com/iperov/DeepFaceLab/.

Ivan Perov, Daiheng Gao, Nikolay Chervoniy, Kunlin Liu, Sugasa Marangonda, Chris Umé, Dpfks, Carl Shift Facenheim, Luis RP, Jian Jiang, Sheng Zhang, Pingyu Wu, et al.
arXiv:2005.05535 · cs.CV, cs.LG, cs.MM, eess.IV · submitted May 12, 2020 · updated Jun 29, 2021
abstract · pdf · html

add comment on HN

This might come in handy to thwart state surveillance by flooding it with false data. The EU recently and retroactively legalized data mining of petabytes of personal information. Formerly it was illegal to save this data but the commission wanted it to stay. This desert of data is used by police forces to search for criminal behavior and probably soon against any political opposition. Of course not against serious crime like privacy breaches of millions of citizens. Actual and real crimes committed by the police itself. The only remedy I see is making this data unusable and such generators might come in very handy for that.