paper-with-me

홈 › Papers

IDK-S: Incremental Distributional Kernel for Streaming Anomaly Detection

2025-12-05 · Yang Xu, Yixiao Ma, Kaifeng Zhang, Zuliang Yang, Kai Ming Ting arxiv

Anomaly detection on data streams presents significant challenges, requiring methods to maintain high detection accuracy among evolving distributions while ensuring real-time efficiency. Here we introduce $\mathcal{IDK}$-$\mathcal{S}$, a novel $\mathbf{I}$ncremental $\mathbf{D}$istributional $\mathbf{K}$ernel for $\mathbf{S}$treaming anomaly detection that effectively addresses these challenges by creating a new dynamic representation in the kernel mean embedding framework. The superiority of $\mathcal{IDK}$-$\mathcal{S}$ is attributed to two key innovations. First, it inherits the strengths of the Isolation Distributional Kernel, an offline detector that has demonstrated significant performance advantages over foundational methods like Isolation Forest and Local Outlier Factor due to the use of a data-dependent kernel. Second, it adopts a lightweight incremental update mechanism that significantly reduces computational overhead compared to the naive baseline strategy of performing a full model retraining. This is achieved without compromising detection accuracy, a claim supported by its statistical equivalence to the full retrained model. Our extensive experiments on thirteen benchmarks demonstrate that $\mathcal{IDK}$-$\mathcal{S}$ achieves superior detection accuracy while operating substantially faster, in many cases by an order of magnitude, than existing state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2512.05531

Code (0)

등록된 구현이 없습니다.

Tasks

Anomaly Detection

Similar Papers 제목 키워드 기반

Isolation Distributional Kernel: A New Tool for Point & Group Anomaly Detection

2020-09-24 · Kai Ming Ting, Bi-Cun Xu, Takashi Washio, Zhi-Hua Zhou

We introduce Isolation Distributional Kernel as a new way to measure the similarity between two distributions. Existing approaches based on kernel mean embedding, which convert a point kernel to a distributional kernel, …

Anomaly DetectionGroup Anomaly Detection

InQMAD: Incremental Quantum Measurement Anomaly Detection

2022-10-11 · Joseph Gallego-Mejia, Oscar Bustos-Brinez, Fabio Gonzalez

Streaming anomaly detection refers to the problem of detecting anomalous data samples in streams of data. This problem poses challenges that classical and deep anomaly detection methods are not designed to cope with, suc…

Anomaly DetectionDensity Estimation

Expected Similarity Estimation for Large-Scale Batch and Streaming Anomaly Detection

2016-01-25 · Markus Schneider, Wolfgang Ertel, Fabio Ramos

We present a novel algorithm for anomaly detection on very large datasets and data streams. The method, named EXPected Similarity Estimation (EXPoSE), is kernel-based and able to efficiently compute the similarity betwee…

Anomaly DetectionIncremental Learning

Real-time Anomaly Detection for Multivariate Data Streams

2022-09-26 · Kenneth Odoh

We present a real-time multivariate anomaly detection algorithm for data streams based on the Probabilistic Exponentially Weighted Moving Average (PEWMA). Our formulation is resilient to (abrupt transient, abrupt distrib…

Anomaly Detection

Binary Anomaly Detection in Streaming IoT Traffic under Concept Drift

2025-10-31 · Rodrigo Matos Carnier, Laura Lahesoo, Kensuke Fukuda arxiv

With the growing volume of Internet of Things (IoT) network traffic, machine learning (ML)-based anomaly detection is more relevant than ever. Traditional batch learning models face challenges such as high maintenance an…

Binary ClassificationIncremental LearningAnomaly Detection