Distance approximation using Isolation Forests
This work briefly explores the possibility of approximating spatial distance (alternatively, similarity) between data points using the Isolation Forest method envisioned for outlier detection. The logic is similar to that of isolation: the more similar or closer two points are, the more random splits it will take to separate them. The separation depth between two points can be standardized in the same way as the isolation depth, transforming it into a distance metric that is limited in range, centered, and in compliance with the axioms of distance. This metric presents some desirable properties such as being invariant to the scales of variables or being able to account for non-linear relationships between variables, which other metrics such as Euclidean or Mahalanobis distance do not. Extensions to the Isolation Forest method are also proposed for handling categorical variables and missing values, resulting in a more generalizable and robust metric.
Code (1)
Tasks
Missing ValuesOutlier DetectionSimilar Papers 제목 키워드 기반
Isolation forest
Most existing model-based approaches to anomaly detection construct a profile of normal instances, then identify instances that do not conform to the normal profile as anomalies. This paper proposes a fundamentally diffe…
Anomaly DetectionUnsupervised Anomaly Detection with Specified Settings -- 0.1% anomalyUnsupervised Anomaly Detection with Specified Settings -- 10% anomalyUnsupervised Anomaly Detection with Specified Settings -- 1% anomaly+2Operational range bounding of spectroscopy models with anomaly detection
Safe operation of machine learning models requires architectures that explicitly delimit their operational ranges. We evaluate the ability of anomaly detection algorithms to provide indicators correlated with degraded mo…
Anomaly DetectionIsolation forests: looking beyond tree depth
The isolation forest algorithm for outlier detection exploits a simple yet effective observation: if taking some multivariate data and making uniformly random cuts across the feature space recursively, it will take fewer…
Outlier DetectionRandom Forests on Distance Matrices for Imaging Genetics Studies
We propose a non-parametric regression methodology, Random Forests on Distance Matrices (RFDM), for detecting genetic variants associated to quantitative phenotypes representing the human brain's structure or function, a…
regressionDistribution and volume based scoring for Isolation Forests
We make two contributions to the Isolation Forest method for anomaly and outlier detection. The first contribution is an information-theoretically motivated generalisation of the score function that is used to aggregate …
Outlier Detection