about
Poisoning Attacks against Support Vector Machines (arxiv.org)
1 point by ColinWright on Jul 23, 2012 | hide | past | pdf | discuss on HN

In plain words: Attackers add fake training points chosen to push a support vector machine's decision boundary the wrong way, by climbing the error gradient computed from how the classifier's best solution shifts. This reliably finds strong attacks that sharply raise the classifier's error on new data.

Abstract

We investigate a family of poisoning attacks against Support Vector Machines (SVM). Such attacks inject specially crafted training data that increases the SVM's test error. Central to the motivation for these attacks is the fact that most learning algorithms assume that their training data comes from a natural or well-behaved distribution. However, this assumption does not generally hold in security-sensitive settings. As we demonstrate, an intelligent adversary can, to some extent, predict the change of the SVM's decision function due to malicious input and use this ability to construct malicious data. The proposed attack uses a gradient ascent strategy in which the gradient is computed based on properties of the SVM's optimal solution. This method can be kernelized and enables the attack to be constructed in the input space even for non-linear kernels. We experimentally demonstrate that our gradient ascent procedure reliably identifies good local maxima of the non-convex validation error surface, which significantly increases the classifier's test error.

Battista Biggio, Blaine Nelson, Pavel Laskov
arXiv:1206.6389 · cs.LG, cs.CR, stat.ML · submitted Jun 27, 2012 · updated Mar 25, 2013
abstract · pdf · html · Appears in Proceedings of the 29th International Conference on Machine Learning (ICML 2012)

add comment on HN
Also discussed: Dec 2012 (2 points, 0 comments) · Jul 2012 (1 point, 0 comments)