paper-with-me

Papers

Isolation Distributional Kernel: A New Tool for Point & Group Anomaly Detection

2020-09-24 · Kai Ming Ting, Bi-Cun Xu, Takashi Washio, Zhi-Hua Zhou

We introduce Isolation Distributional Kernel as a new way to measure the similarity between two distributions. Existing approaches based on kernel mean embedding, which convert a point kernel to a distributional kernel, have two key issues: the point kernel employed has a feature map with intractable dimensionality; and it is {\em data independent}. This paper shows that Isolation Distributional Kernel (IDK), which is based on a {\em data dependent} point kernel, addresses both key issues. We demonstrate IDK's efficacy and efficiency as a new tool for kernel based anomaly detection for both point and group anomalies. Without explicit learning, using IDK alone outperforms existing kernel based point anomaly detector OCSVM and other kernel mean embedding methods that rely on Gaussian kernel. For group anomaly detection,we introduce an IDK based detector called IDK$^2$. It reformulates the problem of group anomaly detection in input space into the problem of point anomaly detection in Hilbert space, without the need for learning. IDK$^2$ runs orders of magnitude faster than group anomaly detector OCSMM.We reveal for the first time that an effective kernel based anomaly detector based on kernel mean embedding must employ a characteristic kernel which is data dependent.

📄 PDF Abstract BibTeX arXiv:2009.12196

Code (1)

IsolationKernel/Codes

Tasks

Anomaly DetectionGroup Anomaly Detection

Similar Papers 제목 키워드 기반

Detecting Change Intervals with Isolation Distributional Kernel

2022-12-30 · Yang Cao, Ye Zhu, Kai Ming Ting, Flora D. Salim 외

Detecting abrupt changes in data distribution is one of the most significant tasks in streaming data analysis. Although many unsupervised Change-Point Detection (CPD) methods have been proposed recently to identify those…

Change Point Detection

Distribution-Based Trajectory Clustering

2023-10-08 · Zi Jing Wang, Ye Zhu, Kai Ming Ting

Trajectory clustering enables the discovery of common patterns in trajectory data. Current methods of trajectory clustering rely on a distance measure between two points in order to measure the dissimilarity between two …

ClusteringTrajectory Clustering

An Online Automatic Modulation Classification Scheme Based on Isolation Distributional Kernel

2024-10-03 · Xinpeng Li, Zile Jiang, Kai Ming Ting, Ye Zhu

Automatic Modulation Classification (AMC), as a crucial technique in modern non-cooperative communication networks, plays a key role in various civil and military applications. However, existing AMC methods usually are c…

MIK: Modified Isolation Kernel for Biological Sequence Visualization, Classification, and Clustering

2024-10-21 · Sarwan Ali, Prakash Chourasia, Haris Mansoor, Bipin Koirala 외

The t-Distributed Stochastic Neighbor Embedding (t-SNE) has emerged as a popular dimensionality reduction technique for visualizing high-dimensional data. It computes pairwise similarities between data points by default …

ClusteringComputational EfficiencyDensity EstimationDimensionality Reduction

Improving the Effectiveness and Efficiency of Stochastic Neighbour Embedding with Isolation Kernel

2019-06-24 · Ye Zhu, Kai Ming Ting

This paper presents a new insight into improving the performance of Stochastic Neighbour Embedding (t-SNE) by using Isolation kernel instead of Gaussian kernel. Isolation kernel outperforms Gaussian kernel in two aspects…