paper-with-me

홈 › Papers

Machine learning-based network intrusion detection for big and imbalanced data using oversampling, stacking feature embedding and feature extraction

2024-01-22 · Md. Alamin Talukder, Md. Manowarul Islam, Md Ashraf Uddin, Khondokar Fida Hasan, Selina Sharmin, Salem A. Alyami, Mohammad Ali Moni

Cybersecurity has emerged as a critical global concern. Intrusion Detection Systems (IDS) play a critical role in protecting interconnected networks by detecting malicious actors and activities. Machine Learning (ML)-based behavior analysis within the IDS has considerable potential for detecting dynamic cyber threats, identifying abnormalities, and identifying malicious conduct within the network. However, as the number of data grows, dimension reduction becomes an increasingly difficult task when training ML models. Addressing this, our paper introduces a novel ML-based network intrusion detection model that uses Random Oversampling (RO) to address data imbalance and Stacking Feature Embedding based on clustering results, as well as Principal Component Analysis (PCA) for dimension reduction and is specifically designed for large and imbalanced datasets. This model's performance is carefully evaluated using three cutting-edge benchmark datasets: UNSW-NB15, CIC-IDS-2017, and CIC-IDS-2018. On the UNSW-NB15 dataset, our trials show that the RF and ET models achieve accuracy rates of 99.59% and 99.95%, respectively. Furthermore, using the CIC-IDS2017 dataset, DT, RF, and ET models reach 99.99% accuracy, while DT and RF models obtain 99.94% accuracy on CIC-IDS2018. These performance results continuously outperform the state-of-art, indicating significant progress in the field of network intrusion detection. This achievement demonstrates the efficacy of the suggested methodology, which can be used practically to accurately monitor and identify network traffic intrusions, thereby blocking possible threats.

📄 PDF Abstract BibTeX arXiv:2401.12262

Code (0)

등록된 구현이 없습니다.

Tasks

BlockingDimensionality ReductionIntrusion DetectionNetwork Intrusion Detection

Similar Papers 제목 키워드 기반

The Effective Methods for Intrusion Detection With Limited Network Attack Data: Multi-Task Learning and Oversampling

2020-10-06 · Yun Zhou

Recently, many anomaly intrusion detection algorithms have been developed and applied in network security. These algorithms achieve high detection rate on many classical datasets. However, most of them failed to addres…

Intrusion DetectionMulti-Task LearningNetwork Intrusion Detection

WOTBoost: Weighted Oversampling Technique in Boosting for imbalanced learning

2019-10-17 · Wenhao Zhang, Ramin Ramezani, Arash Naeim

Machine learning classifiers often stumble over imbalanced datasets where classes are not equally represented. This inherent bias towards the majority class may result in low accuracy in labeling minority class. Imbalanc…

Fraud DetectionGeneral ClassificationIntrusion DetectionNetwork Intrusion Detection

MLSTL-WSN: Machine Learning-based Intrusion Detection using SMOTETomek in WSNs

2024-02-17 · Md. Alamin Talukder, Selina Sharmin, Md Ashraf Uddin, Md Manowarul Islam 외

Wireless Sensor Networks (WSNs) play a pivotal role as infrastructures, encompassing both stationary and mobile sensors. These sensors self-organize and establish multi-hop connections for communication, collectively sen…

Intrusion Detection

Learning to Detect: A Data-driven Approach for Network Intrusion Detection

2021-08-18 · Zachary Tauscher, Yushan Jiang, Kai Zhang, Jian Wang 외

With massive data being generated daily and the ever-increasing interconnectivity of the world's Internet infrastructures, a machine learning based intrusion detection system (IDS) has become a vital component to protect…

Intrusion DetectionNetwork Intrusion DetectionRepresentation Learning

Oversampling Log Messages Using a Sequence Generative Adversarial Network for Anomaly Detection and Classification

2019-12-09 · Amir Farzad, T. Aaron Gulliver

Dealing with imbalanced data is one of the main challenges in machine/deep learning algorithms for classification. This issue is more important with log message data as it is typically very imbalanced and negative logs a…

Anomaly DetectionClassificationGeneral ClassificationGenerative Adversarial Network