In plain words: A checker proves that tiny changes to an image can't flip a network's answer by hunting for bad examples with gradients while also building a safe proof of the whole region. It beat the best existing checkers on hundreds of test cases.
Abstract · Optimization and Abstraction: A Synergistic Approach for Analyzing Neural Network Robustness
In recent years, the notion of local robustness (or robustness for short) has emerged as a desirable property of deep neural networks. Intuitively, robustness means that small perturbations to an input do not cause the network to perform misclassifications. In this paper, we present a novel algorithm for verifying robustness properties of neural networks. Our method synergistically combines gradient-based optimization methods for counterexample search with abstraction-based proof search to obtain a sound and (δ-)complete decision procedure. Our method also employs a data-driven approach to learn a verification policy that guides abstract interpretation during proof search. We have implemented the proposed approach in a tool called Charon and experimentally evaluated it on hundreds of benchmarks. Our experiments show that the proposed approach significantly outperforms three state-of-the-art tools, namely AI^2 , Reluplex, and Reluval.
Greg Anderson, Shankara Pailoor, Isil Dillig, Swarat Chaudhuri
arXiv:1904.09959 · cs.PL, cs.LG · submitted Apr 22, 2019 · updated May 1, 2019
abstract · pdf · html