Robust learning of data anomalies with analytically-solvable entropic outlier sparsification
Entropic Outlier Sparsification (EOS) is proposed as a robust computational strategy for the detection of data anomalies in a broad class of learning methods, including the unsupervised problems (like detection of non-Gaussian outliers in mostly-Gaussian data) and in the supervised learning with mislabeled data. EOS dwells on the derived analytic closed-form solution of the (weighted) expected error minimization problem subject to the Shannon entropy regularization. In contrast to common regularization strategies requiring computational costs that scale polynomial with the data dimension, identified closed-form solution is proven to impose additional iteration costs that depend linearly on statistics size and are independent of data dimension. Obtained analytic results also explain why the mixtures of spherically-symmetric Gaussians - used heuristically in many popular data analysis algorithms - represent an optimal choice for the non-parametric probability distributions when working with squared Euclidean distances, combining expected error minimality, maximal entropy/unbiasedness, and a linear cost scaling. The performance of EOS is compared to a range of commonly-used tools on synthetic problems and on partially-mislabeled supervised classification problems from biomedicine.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Outlier Detection for Text Data : An Extended Version
The problem of outlier detection is extremely challenging in many domains such as text, in which the attribute values are typically non-negative, and most values are zero. In such cases, it often becomes difficult to sep…
AttributeOutlier DetectionSinkhorn-CPD: Robust point cloud registration via unbalanced entropic optimal transport
Coherent Point Drift (CPD) is widely used for rigid point cloud registration because of its soft correspondences and closed-form parameter updates. However, CPD's target-side marginal constraint forces every observation,…
Point Cloud RegistrationDetection of Thin Boundaries between Different Types of Anomalies in Outlier Detection using Enhanced Neural Networks
Outlier detection has received special attention in various fields, mainly for those dealing with machine learning and artificial intelligence. As strong outliers, anomalies are divided into the point, contextual and col…
Anomaly DetectionOutlier DetectionRCC-Dual-GAN: An Efficient Approach for Outlier Detection with Few Identified Anomalies
Outlier detection is an important task in data mining and many technologies have been explored in various applications. However, due to the default assumption that outliers are non-concentrated, unsupervised outlier dete…
Outlier DetectionRelaxed Clipping: A Global Training Method for Robust Regression and Classification
Robust regression and classification are often thought to require non-convex loss functions that prevent scalable, global training. However, such a view neglects the possibility of reformulated training methods that can …
ClassificationGeneral Classificationregression