In plain words: A system learns Zelenskyy's typical facial movements and gestures from over eight hours of genuine footage, then checks whether a video matches that personal speaking style. It correctly separated the real president from deep-fake copies.
Abstract · Protecting President Zelenskyy against Deep Fakes
The 2022 Russian invasion of Ukraine is being fought on two fronts: a brutal ground war and a duplicitous disinformation campaign designed to conceal and justify Russia's actions. This campaign includes at least one example of a deep-fake video purportedly showing Ukrainian President Zelenskyy admitting defeat and surrendering. In anticipation of future attacks of this form, we describe a facial and gestural behavioral model that captures distinctive characteristics of Zelenskyy's speaking style. Trained on over eight hours of authentic video from four different settings, we show that this behavioral model can distinguish Zelenskyy from deep-fake imposters.This model can play an important role -- particularly during the fog of war -- in distinguishing the real from the fake.
Matyáš Boháček, Hany Farid
arXiv:2206.12043 · cs.CV, cs.CY · submitted Jun 24, 2022
abstract · pdf · html