paper-with-me

홈 › Papers

Effect of Balancing Data Using Synthetic Data on the Performance of Machine Learning Classifiers for Intrusion Detection in Computer Networks

2022-04-01 · Ayesha S. Dina, A. B. Siddique, D. Manivannan

Attacks on computer networks have increased significantly in recent days, due in part to the availability of sophisticated tools for launching such attacks as well as thriving underground cyber-crime economy to support it. Over the past several years, researchers in academia and industry used machine learning (ML) techniques to design and implement Intrusion Detection Systems (IDSes) for computer networks. Many of these researchers used datasets collected by various organizations to train ML models for predicting intrusions. In many of the datasets used in such systems, data are imbalanced (i.e., not all classes have equal amount of samples). With unbalanced data, the predictive models developed using ML algorithms may produce unsatisfactory classifiers which would affect accuracy in predicting intrusions. Traditionally, researchers used over-sampling and under-sampling for balancing data in datasets to overcome this problem. In this work, in addition to over-sampling, we also use a synthetic data generation method, called Conditional Generative Adversarial Network (CTGAN), to balance data and study their effect on various ML classifiers. To the best of our knowledge, no one else has used CTGAN to generate synthetic samples to balance intrusion detection datasets. Based on extensive experiments using a widely used dataset NSL-KDD, we found that training ML models on dataset balanced with synthetic samples generated by CTGAN increased prediction accuracy by up to $8\%$, compared to training the same ML models over unbalanced data. Our experiments also show that the accuracy of some ML models trained over data balanced with random over-sampling decline compared to the same ML models trained over unbalanced data.

📄 PDF Abstract BibTeX arXiv:2204.00144

Code (0)

등록된 구현이 없습니다.

Tasks

Generative Adversarial NetworkIntrusion DetectionSynthetic Data Generation

Similar Papers 제목 키워드 기반

Are Synthetic Control Weights Balancing Score?

2022-11-03 · Harsh Parikh

In this short note, I outline conditions under which conditioning on Synthetic Control (SC) weights emulates a randomized control trial where the treatment status is independent of potential outcomes. Specifically, I dem…

A Stable and Efficient Covariate-Balancing Estimator for Causal Survival Effects

2023-10-01 · Khiem Pham, David A. Hirshberg, Phuong-Mai Huynh-Pham, Michele Santacatterina 외

We propose an empirically stable and asymptotically efficient covariate-balancing approach to the problem of estimating survival causal effects in data with conditionally-independent censoring. This addresses a challenge…

To SMOTE, or not to SMOTE?

2022-01-21 · Yotam Elor, Hadar Averbuch-Elor

Balancing the data before training a classifier is a popular technique to address the challenges of imbalanced binary classification in tabular data. Balancing is commonly achieved by duplication of minority samples or b…

Binary Classification

SurvCaus : Representation Balancing for Survival Causal Inference

2022-03-29 · Ayoub Abraich, Agathe Guilloux, Blaise Hanczar

Individual Treatment Effects (ITE) estimation methods have risen in popularity in the last years. Most of the time, individual effects are better presented as Conditional Average Treatment Effects (CATE). Recently, repre…

Causal InferencecounterfactualCounterfactual Inference

On the Usefulness of Synthetic Tabular Data Generation

2023-06-27 · Dionysis Manousakas, Sergül Aydöre

Despite recent advances in synthetic data generation, the scientific community still lacks a unified consensus on its usefulness. It is commonly believed that synthetic data can be used for both data exchange and boostin…

Data AugmentationData SummarizationPrivacy PreservingSynthetic Data Generation+1