In plain words: Small image tweaks designed to fool one vision model were adjusted to match early human vision and shown briefly to people. The tweaks that fooled many other models also shifted what time-limited viewers chose, showing humans can be misled the same way.
Abstract · Adversarial Examples that Fool both Computer Vision and Time-Limited Humans
Machine learning models are vulnerable to adversarial examples: small changes to images can cause computer vision models to make mistakes such as identifying a school bus as an ostrich. However, it is still an open question whether humans are prone to similar mistakes. Here, we address this question by leveraging recent techniques that transfer adversarial examples from computer vision models with known parameters and architecture to other models with unknown parameters and architecture, and by matching the initial processing of the human visual system. We find that adversarial examples that strongly transfer across computer vision models influence the classifications made by time-limited human observers.
Gamaleldin F. Elsayed, Shreya Shankar, Brian Cheung, Nicolas Papernot, Alex Kurakin, Ian Goodfellow, Jascha Sohl-Dickstein
arXiv:1802.08195 · cs.LG, cs.CV, q-bio.NC, stat.ML · submitted Feb 22, 2018 · updated May 22, 2018
abstract · pdf · html