about
The Elephant in the Room (arxiv.org)
1 point by jonbaer on Sep 3, 2018 | hide | past | pdf | discuss on HN

In plain words: Pasting a small patch containing an object into a photo makes top object detectors misfire far beyond the pasted spot. Even tiny shifts in where the patch lands can change what the detector calls the other objects in the image.

Abstract

We showcase a family of common failures of state-of-the art object detectors. These are obtained by replacing image sub-regions by another sub-image that contains a trained object. We call this "object transplanting". Modifying an image in this manner is shown to have a non-local impact on object detection. Slight changes in object position can affect its identity according to an object detector as well as that of other objects in the image. We provide some analysis and suggest possible reasons for the reported phenomena.

Amir Rosenfeld, Richard Zemel, John K. Tsotsos
arXiv:1808.03305 · cs.CV, cs.LG · submitted Aug 9, 2018
abstract · pdf · html

add comment on HN
Also discussed: Aug 2018 (2 points, 0 comments)