paper-with-me

Papers

Unsupervised Change Detection using DRE-CUSUM

2022-01-27 · Sudarshan Adiga, Ravi Tandon

This paper presents DRE-CUSUM, an unsupervised density-ratio estimation (DRE) based approach to determine statistical changes in time-series data when no knowledge of the pre-and post-change distributions are available. The core idea behind the proposed approach is to split the time-series at an arbitrary point and estimate the ratio of densities of distribution (using a parametric model such as a neural network) before and after the split point. The DRE-CUSUM change detection statistic is then derived from the cumulative sum (CUSUM) of the logarithm of the estimated density ratio. We present a theoretical justification as well as accuracy guarantees which show that the proposed statistic can reliably detect statistical changes, irrespective of the split point. While there have been prior works on using density ratio based methods for change detection, to the best of our knowledge, this is the first unsupervised change detection approach with a theoretical justification and accuracy guarantees. The simplicity of the proposed framework makes it readily applicable in various practical settings (including high-dimensional time-series data); we also discuss generalizations for online change detection. We experimentally show the superiority of DRE-CUSUM using both synthetic and real-world datasets over existing state-of-the-art unsupervised algorithms (such as Bayesian online change detection, its variants as well as several other heuristic methods).

📄 PDF Abstract BibTeX arXiv:2201.11678

Code (0)

등록된 구현이 없습니다.

Tasks

Change DetectionDensity Ratio EstimationTime SeriesTime Series Analysis

Similar Papers 제목 키워드 기반

Quickest Change Detection with Confusing Change

2024-05-01 · Yu-Zhen Janice Chen, Jinhang Zuo, Venugopal V. Veeravalli, Don Towsley

In the problem of quickest change detection (QCD), a change occurs at some unknown time in the distribution of a sequence of independent observations. This work studies a QCD problem where the change is either a bad chan…

Change Detection

Neural network-based CUSUM for online change-point detection

2022-10-31 · Tingnan Gong, Junghwan Lee, Xiuyuan Cheng, Yao Xie

Change-point detection, detecting an abrupt change in the data distribution from sequential data, is a fundamental problem in statistics and machine learning. CUSUM is a popular statistical method for online change-point…

Change Point DetectionComputational Efficiency

Spectral CUSUM for Online Network Structure Change Detection

2019-10-20 · Minghe Zhang, Liyan Xie, Yao Xie

Detecting abrupt changes in the community structure of a network from noisy observations is a fundamental problem in statistics and machine learning. This paper presents an online change detection algorithm called Spectr…

Change DetectionCommunity DetectionEvent DetectionOnline Community Detection

Quickest Change Detection for Unnormalized Statistical Models

2023-02-01 · Suya Wu, Enmao Diao, Taposh Banerjee, Jie Ding 외

Classical quickest change detection algorithms require modeling pre-change and post-change distributions. Such an approach may not be feasible for various machine learning models because of the complexity of computing th…

Change Detection

An Evaluation of Real-time Adaptive Sampling Change Point Detection Algorithm using KCUSUM

2024-02-15 · Vijayalakshmi Saravanan, Perry Siehien, Shinjae Yoo, Hubertus van Dam 외

Detecting abrupt changes in real-time data streams from scientific simulations presents a challenging task, demanding the deployment of accurate and efficient algorithms. Identifying change points in live data stream inv…

Change DetectionChange Point DetectionProtein Folding