In plain words: People were filmed walking while lying, and their steps and gestures became 3D body poses that a neural network reads alongside cues from psychology research to spot deception. It got 88.41% of cases right, beating hand-built cue features by 10.6%.
Abstract
We present a data-driven deep neural algorithm for detecting deceptive walking behavior using nonverbal cues like gaits and gestures. We conducted an elaborate user study, where we recorded many participants performing tasks involving deceptive walking. We extract the participants' walking gaits as series of 3D poses. We annotate various gestures performed by participants during their tasks. Based on the gait and gesture data, we train an LSTM-based deep neural network to obtain deep features. Finally, we use a combination of psychology-based gait, gesture, and deep features to detect deceptive walking with an accuracy of 88.41%. This is an improvement of 10.6% over handcrafted gait and gesture features and an improvement of 4.7% and 9.2% over classifiers based on the state-of-the-art emotion and action classification algorithms, respectively. Additionally, we present a novel dataset, DeceptiveWalk, that contains gaits and gestures with their associated deception labels. To the best of our knowledge, ours is the first algorithm to detect deceptive behavior using non-verbal cues of gait and gesture.
Tanmay Randhavane, Uttaran Bhattacharya, Kyra Kapsaskis, Kurt Gray, Aniket Bera, Dinesh Manocha
arXiv:1912.06874 · cs.CV, cs.LG · submitted Dec 14, 2019 · updated Mar 29, 2020
abstract · pdf · html · 10 pages, 6 Figures
Yikes. Anyone getting a feeling of some racial bias in this experimental setup?
https://www.dailytarheel.com/article/2018/04/diversity-0426
>As of fall 2017, UNC-Chapel Hill had a 7.8 percent enrollment rate for Black students, one of the lowest in the state, while just over 22 percent of residents in North Carolina are Black.
Not to mention, there doesn't seem to have been any control in this experiment. What a bunch of nonsense. These students were told to act sketchy, and predictably probably hammed it up to please the experimenters (see: they stuck their hands in their pockets, looked around a lot, etc).