SELECTING KDD FEATURES AND USING RANDOM CLASSIFICATION TREE FOR PREDICTING ATTACKS

Authors

  • Rachid Beghdad

DOI:

https://doi.org/10.47839/ijc.6.3.460

Keywords:

Intrusion detection systems, Data mining, Misuse intrusion detection, Fisher’s ANOVA ranking, Knowledge Discovery and Data mining (KDD) dataset, Classification Trees

Abstract

The purpose of this study is to identify some higher-level KDD features, and to train the resulting set with an appropriate machine learning technique, in order to classify and predict attacks. To achieve that, a two-steps approach is proposed. Firstly, the Fisher’s ANOVA technique was used to deduce the important features. Secondly, 4 types of classification trees: ID3, C4.5, classification and regression tree (CART), and random tree (RnDT), were tested to classify and detect attacks. According to our tests, the RndT leads to the better results. That is why we will present here the classification and prediction results of this technique in details. Some of the remaining results will be used later to make comparisons. We used the KDD’99 data sets to evaluate the considered algorithms. For these evaluations, only the four attack categories’ case was considered. Our simulations show the efficiency of our approach, and show also that it is very competitive with some similar previous works.

References

D.-K. Kang, D. Fuller, V. Honavar, “Learning Classifiers for Misuse and Anomaly Detection Using a Bag of System Calls Representation », in Proceedings of the 2005 IEEE Workshop on Information Assurance and Security United States Military Academy, West Point, NY, pp. 118-125, 2005.

W. Lee W, S. Stolfo, K. Mok. “A data mining framework for building intrusion detection models”. In Proceedings of the IEEE symposium on security and privacy; pp. 120-132,1999.

L. Xiangyang, Y. Nong, “Decision tree classifiers for computer intrusion detection”, book chapter, Real-time system security, Nova Science Publishers, pp. 77-93, 2003.

G. Folino, C. Pizzuti and G. Spezzano, “GP Ensemble for Distributed Intrusion Detection Systems”, book chapter, Pattern Recognition and Data Mining, Volume 3686/2005, Springer Verlag, pp. 54-62, 2005.

A. H. Sung, S. Mukkamala, “Identifying important features for intrusion detection using support vector machines and neural networks”. In: Proceedings of International Symposium on Applications and the Internet (SAINT 2003); pp. 209-217, 2003.

S. Chebrolu, A. Abraham, J. P. Thomas, “Feature deduction and ensemble design of intrusion detection systems”, Journal of Computers and Security, Elsevier, Volume 24, Issue 4 , pp. 295-307, 2005.

R. Lippmann, S. Cunningham, “Improving intrusion detection performance using keyword selection and neural networks.” Computer Networks;34(4):594-603, 2000.

M. Middlemiss, G. Dick, “Feature selection of intrusion detection data using a hybrid genetic algorithm/KNN approach”, book chapter, Design and application of hybrid intelligent systems, IOS press, pp. 519-527, 2003.

S. Khusbu, and al., “Adaptive neuro-fuzzy intrusion detection system”. In: IEEE International Conference on Information Technology: Coding and Computing (ITCC’04), Portugal, vol. 1. USA: IEEE Computer Society; p. 70-74, 2004.

L. Breiman, J. Friedman, R. A. Olshen and C. J. Stone, "Classification and regression trees". Monterey, CA Wadsworth & Brooks, 1984.

Quinlan, J. R.: C4.5, Programs for machine learning. Morgan Kaufmann San Mateo Ca, 1993.

L. Breiman, "Random Forests". Machine Learning 45 (1), 5-32, 2001.

H. T. Kam, "Random Decision Forest". Proc. of the 3rd Int'l Conf. on Document Analysis and Recognition, Montreal, Canada, August 14-18, pp. 278-282, 1995.

Ricco Rakotomalala, "Tanagra : a free software for training and research", in Actes de EGC'2005, RNTI-E-3, vol. 2, pp.697-702, 2005.

KDD data set, 1999; http://kdd.ics.uci.edu/databases/kddcup99/kddcup99.html, accessed on July 2006.

N. Ben Amor, and al., “Naive Bayes vs Decision Trees in Intrusion Detection Systems”, in the Proceeding of the ACM Symposium on Applied Computing, Cyprus, pp. 420-424, 2004.

Downloads

Published

2014-08-01

How to Cite

Beghdad, R. (2014). SELECTING KDD FEATURES AND USING RANDOM CLASSIFICATION TREE FOR PREDICTING ATTACKS. International Journal of Computing, 6(3), 115-123. https://doi.org/10.47839/ijc.6.3.460

Issue

Section

Articles