paper-with-me

홈 › Papers

Robust Statistical Scaling of Outlier Scores: Improving the Quality of Outlier Probabilities for Outliers (Extended Version)

2024-08-28 · Philipp Röchner, Henrique O. Marques, Ricardo J. G. B. Campello, Arthur Zimek, Franz Rothlauf

Outlier detection algorithms typically assign an outlier score to each observation in a dataset, indicating the degree to which an observation is an outlier. However, these scores are often not comparable across algorithms and can be difficult for humans to interpret. Statistical scaling addresses this problem by transforming outlier scores into outlier probabilities without using ground-truth labels, thereby improving interpretability and comparability across algorithms. However, the quality of this transformation can be different for outliers and inliers. Missing outliers in scenarios where they are of particular interest - such as healthcare, finance, or engineering - can be costly or dangerous. Thus, ensuring good probabilities for outliers is essential. This paper argues that statistical scaling, as commonly used in the literature, does not produce equally good probabilities for outliers as for inliers. Therefore, we propose robust statistical scaling, which uses robust estimators to improve the probabilities for outliers. We evaluate several variants of our method against other outlier score transformations for real-world datasets and outlier detection algorithms, where it can improve the probabilities for outliers.

📄 PDF Abstract BibTeX arXiv:2408.15874

Code (0)

등록된 구현이 없습니다.

Tasks

Outlier Detection

Similar Papers 제목 키워드 기반

Outlier Detection for Robust Multi-dimensional Scaling

2018-02-07 · Leonid Blouvshtein, Daniel Cohen-Or

Multi-dimensional scaling (MDS) plays a central role in data-exploration, dimensionality reduction and visualization. State-of-the-art MDS algorithms are not robust to outliers, yielding significant errors in the embeddi…

Dimensionality ReductionOutlier Detection

Weighted Scaling Approach for Metabolomics Data Analysis

2022-08-01 · Biplab Biswas, Nishith Kumar, Md Aminul Hoque, Md ashad Alam

Systematic variation is a common issue in metabolomics data analysis. Therefore, different scaling and normalization techniques are used to preprocess the data for metabolomics data analysis. Although several scaling met…

Outlier Detection

Linear-time Outlier Detection via Sensitivity

2016-05-02 · Mario Lucic, Olivier Bachem, Andreas Krause

Outliers are ubiquitous in modern data sets. Distance-based techniques are a popular non-parametric approach to outlier detection as they require no prior assumptions on the data generating distribution and are simple to…

ClusteringOutlier DetectionSensitivity

Improved Training Technique for Latent Consistency Models

2025-02-03 · Quan Dao, Khanh Doan, Di Liu, Trung Le 외

Consistency models are a new family of generative models capable of producing high-quality samples in either a single step or multiple steps. Recently, consistency models have demonstrated impressive performance, achievi…

Video Generation

Neighborhood Averaging for Improving Outlier Detectors

2023-03-17 · Jiawei Yang, Susanto Rahardja, Pasi Franti

We hypothesize that similar objects should have similar outlier scores. To our knowledge, all existing outlier detectors calculate the outlier score for each object independently regardless of the outlier scores of the o…