paper-with-me

Papers

Outlier Detection on Mixed-Type Data: An Energy-based Approach

2016-08-17 · Kien Do, Truyen Tran, Dinh Phung, Svetha Venkatesh

Outlier detection amounts to finding data points that differ significantly from the norm. Classic outlier detection methods are largely designed for single data type such as continuous or discrete. However, real world data is increasingly heterogeneous, where a data point can have both discrete and continuous attributes. Handling mixed-type data in a disciplined way remains a great challenge. In this paper, we propose a new unsupervised outlier detection method for mixed-type data based on Mixed-variate Restricted Boltzmann Machine (Mv.RBM). The Mv.RBM is a principled probabilistic method that models data density. We propose to use \emph{free-energy} derived from Mv.RBM as outlier score to detect outliers as those data points lying in low density regions. The method is fast to learn and compute, is scalable to massive datasets. At the same time, the outlier score is identical to data negative log-density up-to an additive constant. We evaluate the proposed method on synthetic and real-world datasets and demonstrate that (a) a proper handling mixed-types is necessary in outlier detection, and (b) free-energy of Mv.RBM is a powerful and efficient outlier scoring method, which is highly competitive against state-of-the-arts.

📄 PDF Abstract BibTeX arXiv:1608.04830

Code (1)

clarken92/Mixed-variate-RBM

Tasks

Outlier DetectionVocal Bursts Type Prediction

Similar Papers 제목 키워드 기반

Robust Variational Autoencoders for Outlier Detection and Repair of Mixed-Type Data

2019-07-15 · Simão Eduardo, Alfredo Nazábal, Christopher K. I. Williams, Charles Sutton

We focus on the problem of unsupervised cell outlier detection and repair in mixed-type tabular data. Traditional methods are concerned only with detecting which rows in the dataset are outliers. However, identifying whi…

ImputationOutlier Detection

MIX: A Joint Learning Framework for Detecting Both Clustered and Scattered Outliers in Mixed-Type Data

2019-11-01 · Hongzuo Xu, Yijie Wang, Yongjun Wang, Zhiyue Wu

Mixed-type data are pervasive in real life, but very limited outlier detection methods are available for these data. Some existing methods handle mixed-type data by feature converting, whereas their performance is downgr…

Anomaly DetectionOutlier Detection

Simple robust genomic prediction and outlier detection for a multi-environmental field trial

2018-07-19

The aim of plant breeding trials is often to identify germplasms that are well adapt to target environments. These germplasms are identified through genomic prediction from the analysis of multi-environmental field trial…

Outlier DetectionPrediction

Learning Representations for Outlier Detection on a Budget

2015-07-29 · Barbora Micenková, Brian McWilliams, Ira Assent

The problem of detecting a small number of outliers in a large dataset is an important task in many fields from fraud detection to high-energy physics. Two approaches have emerged to tackle this problem: unsupervised and…

Fraud DetectionOutlier Detection

A Secure Clustering Protocol with Fuzzy Trust Evaluation and Outlier Detection for Industrial Wireless Sensor Networks

2022-07-20 · Liu Yang, Yinzhi Lu, Simon X. Yang, Tan Guo 외

Security is one of the major concerns in Industrial Wireless Sensor Networks (IWSNs). To assure the security in clustered IWSNs, this paper presents a secure clustering protocol with fuzzy trust evaluation and outlier de…

ClusteringOutlier Detection