Cluster Purging: Efficient Outlier Detection based on Rate-Distortion Theory
Rate-distortion theory-based outlier detection builds upon the rationale that a good data compression will encode outliers with unique symbols. Based on this rationale, we propose Cluster Purging, which is an extension of clustering-based outlier detection. This extension allows one to assess the representivity of clusterings, and to find data that are best represented by individual unique clusters. We propose two efficient algorithms for performing Cluster Purging, one being parameter-free, while the other algorithm has a parameter that controls representivity estimations, allowing it to be tuned in supervised setups. In an experimental evaluation, we show that Cluster Purging improves upon outliers detected from raw clusterings, and that Cluster Purging competes strongly against state-of-the-art alternatives.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringData CompressionOutlier DetectionSimilar Papers 제목 키워드 기반
Generalized Dirichlet-process-means for $f$-separable distortion measures
DP-means clustering was obtained as an extension of $K$-means clustering. While it is implemented with a simple and efficient algorithm, it can estimate the number of clusters simultaneously. However, DP-means is specifi…
ClusteringDetecting outliers by clustering algorithms
Clustering and outlier detection are two important tasks in data mining. Outliers frequently interfere with clustering algorithms to determine the similarity between objects, resulting in unreliable clustering results. C…
ClusteringOutlier DetectionOutlier Detection using Improved Genetic K-means
The outlier detection problem in some cases is similar to the classification problem. For example, the main concern of clustering-based outlier detection algorithms is to find clusters and outliers, which are often regar…
ClusteringGeneral ClassificationOutlier DetectionDeep Clustering based Fair Outlier Detection
In this paper, we focus on the fairness issues regarding unsupervised outlier detection. Traditional algorithms, without a specific design for algorithmic fairness, could implicitly encode and propagate statistical bias …
AttributeClusteringDeep ClusteringFairness+2Outlier Cluster Formation in Spectral Clustering
Outlier detection and cluster number estimation is an important issue for clustering real data. This paper focuses on spectral clustering, a time-tested clustering method, and reveals its important properties related to …
ClusteringFace ClusteringOutlier DetectionPerson Re-Identification+1