Restricted Minimum Error Entropy Criterion for Robust Classification
The minimum error entropy (MEE) criterion has been verified as a powerful approach for non-Gaussian signal processing and robust machine learning. However, the implementation of MEE on robust classification is rather a vacancy in the literature. The original MEE only focuses on minimizing the Renyi's quadratic entropy of the error probability distribution function (PDF), which could cause failure in noisy classification tasks. To this end, we analyze the optimal error distribution in the presence of outliers for those classifiers with continuous errors, and introduce a simple codebook to restrict MEE so that it drives the error PDF towards the desired case. Half-quadratic based optimization and convergence analysis of the new learning criterion, called restricted MEE (RMEE), are provided. Experimental results with logistic regression and extreme learning machine are presented to verify the desirable robustness of RMEE.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationDimensionality ReductionGeneral ClassificationQuantizationRobust classificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Generalized Minimum Error Entropy for Adaptive Filtering
Error entropy is a important nonlinear similarity measure, and it has received increasing attention in many practical applications. The default kernel function of error entropy criterion is Gaussian kernel function, howe…
Generalized Minimum Error with Fiducial Points Criterion for Robust Learning
The conventional Minimum Error Entropy criterion (MEE) has its limitations, showing reduced sensitivity to error mean values and uncertainty regarding error probability density function locations. To overcome this, a MEE…
Acoustic echo cancellationNonlinear Equalization for TDMR Channels Using Neural Networks
This paper presents new structure and adaptation criterion for equalization of two-dimensional magnetic recording channels, as opposed to typical linear equalizer with minimum mean square error (MMSE) as adaptation crite…
Quantized Minimum Error Entropy Criterion
Comparing with traditional learning criteria, such as mean square error (MSE), the minimum error entropy (MEE) criterion is superior in nonlinear and non-Gaussian signal processing and machine learning. The argument of t…
QuantizationAdaptively Solving the Local-Minimum Problem for Deep Neural Networks
This paper aims to overcome a fundamental problem in the theory and application of deep neural networks (DNNs). We propose a method to solve the local minimum problem in training DNNs directly. Our method is based on the…