Kernel density estimation-based sampling for neural network classification
Imbalanced data occurs in a wide range of scenarios. The skewed distribution of the target variable elicits bias in machine learning algorithms. One of the popular methods to combat imbalanced data is to artificially balance the data through resampling. In this paper, we compare the efficacy of a recently proposed kernel density estimation (KDE) sampling technique in the context of artificial neural networks. We benchmark the KDE sampling method against two base sampling techniques and perform comparative experiments using 8 datasets and 3 neural networks architectures. The results show that KDE sampling produces the best performance on 6 out of 8 datasets. However, it must be used with caution on image datasets. We conclude that KDE sampling is capable of significantly improving the performance of neural networks.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationDensity EstimationSimilar Papers 제목 키워드 기반
Sub-linear RACE Sketches for Approximate Kernel Density Estimation on Streaming Data
Kernel density estimation is a simple and effective method that lies at the heart of many important machine learning applications. Unfortunately, kernel methods scale poorly for large, high dimensional datasets. Approxim…
Density EstimationKernel density estimation based sampling for imbalanced class distribution
Imbalanced response variable distribution is a common occurrence in data science. In fields such as fraud detection, medical diagnostics, system intrusion detection and many others where abnormal behavior is rarely obser…
Density EstimationFraud DetectionIntrusion DetectionKernel Density Matrices for Probabilistic Deep Learning
This paper introduces a novel approach to probabilistic deep learning, kernel density matrices, which provide a simpler yet effective mechanism for representing joint probability distributions of both continuous and disc…
Deep LearningDensity Estimationimage-classificationImage Classification+2An optimal transport approach for selecting a representative subsample with application in efficient kernel density estimation
Subsampling methods aim to select a subsample as a surrogate for the observed sample. Such methods have been used pervasively in large-scale data analytics, active learning, and privacy-preserving analysis in recent deca…
Active LearningDensity EstimationPrivacy PreservingMedian of Forests for Robust Density Estimation
Robust density estimation refers to the consistent estimation of the density function even when the data is contaminated by outliers. We find that existing forest density estimation at a certain point is inherently resis…
Anomaly DetectionDensity EstimationEnsemble Learning