about
Anomaly Detection Using Rule Extraction for Efficient Intrusion Detection (2014) (arxiv.org)
2 points by Elof on Apr 12, 2019 | hide | past | pdf | discuss on HN

In plain words: It shrinks network logs to their key signals, spots odd traffic without labels, then turns those patterns into simple if-then rules that sort traffic instantly. On a standard intrusion dataset and real logs it worked well, and its rules are easy for admins to read.

Abstract · Anomaly Detection Framework Using Rule Extraction for Efficient Intrusion Detection

Huge datasets in cyber security, such as network traffic logs, can be analyzed using machine learning and data mining methods. However, the amount of collected data is increasing, which makes analysis more difficult. Many machine learning methods have not been designed for big datasets, and consequently are slow and difficult to understand. We address the issue of efficient network traffic classification by creating an intrusion detection framework that applies dimensionality reduction and conjunctive rule extraction. The system can perform unsupervised anomaly detection and use this information to create conjunctive rules that classify huge amounts of traffic in real time. We test the implemented system with the widely used KDD Cup 99 dataset and real-world network logs to confirm that the performance is satisfactory. This system is transparent and does not work like a black box, making it intuitive for domain experts, such as network administrators.

Antti Juvonen, Tuomo Sipola
arXiv:1410.7709 · cs.LG, cs.CR · submitted Oct 28, 2014
abstract · pdf · html · 35 pages, 12 figures, 7 tables

add comment on HN