Hyperparameter Optimization for Unsupervised Outlier Detection
Given an unsupervised outlier detection (OD) algorithm, how can we optimize its hyperparameter(s) (HP) on a new dataset, without any labels? In this work, we address this challenging hyperparameter optimization for unsupervised OD problem, and propose the first systematic approach called HPOD that is based on meta-learning. HPOD capitalizes on the prior performance of a large collection of HPs on existing OD benchmark datasets, and transfers this information to enable HP evaluation on a new dataset without labels. Moreover, HPOD adapts a prominent sampling paradigm to identify promising HPs efficiently. Extensive experiments show that HPOD works with both deep (e.g., Robust AutoEncoder) and shallow (e.g., Local Outlier Factor (LOF) and Isolation Forest (iForest)) OD algorithms on discrete and continuous HP spaces, and outperforms a wide range of baselines with on average 58% and 66% performance improvement over the default HPs of LOF and iForest.
Code (0)
등록된 구현이 없습니다.
Tasks
Hyperparameter OptimizationMeta-LearningOutlier DetectionSimilar Papers 제목 키워드 기반
A Large-scale Study on Unsupervised Outlier Model Selection: Do Internal Strategies Suffice?
Given an unsupervised outlier detection task, how should one select a detection algorithm as well as its hyperparameters (jointly called a model)? Unsupervised model selection is notoriously difficult, in the absence of …
Model SelectionOutlier DetectionUniOD: A Universal Model for Outlier Detection across Diverse Domains
Outlier detection (OD), distinguishing inliers and outliers in completely unlabeled datasets, plays a vital role in science and engineering. Although there have been many insightful OD methods, most of them require troub…
Node ClassificationOutlier DetectionBoundary Peeling: Outlier Detection Method Using One-Class Peeling
Unsupervised outlier detection constitutes a crucial phase within data analysis and remains a dynamic realm of research. A good outlier detection algorithm should be computationally efficient, robust to tuning parameter …
Outlier DetectionSUOD: Accelerating Large-Scale Unsupervised Heterogeneous Outlier Detection
Outlier detection (OD) is a key machine learning (ML) task for identifying abnormal objects from general samples with numerous high-stake applications including fraud detection and intrusion detection. Due to the lack of…
Dimensionality ReductionFraud DetectionIntrusion DetectionOutlier Detection+1Automating Outlier Detection via Meta-Learning
Given an unsupervised outlier detection (OD) task on a new dataset, how can we automatically select a good outlier detection method and its hyperparameter(s) (collectively called a model)? Thus far, model selection for O…
Anomaly DetectionAutoMLMeta-LearningModel Selection+1