paper-with-me

홈 › Papers

Fast likelihood-based change point detection

2023-01-21 · Nikolaj Tatti

Change point detection plays a fundamental role in many real-world applications, where the goal is to analyze and monitor the behaviour of a data stream. In this paper, we study change detection in binary streams. To this end, we use a likelihood ratio between two models as a measure for indicating change. The first model is a single bernoulli variable while the second model divides the stored data in two segments, and models each segment with its own bernoulli variable. Finding the optimal split can be done in $O(n)$ time, where $n$ is the number of entries since the last change point. This is too expensive for large $n$. To combat this we propose an approximation scheme that yields $(1 - \epsilon)$ approximation in $O(\epsilon^{-1} \log^2 n)$ time. The speed-up consists of several steps: First we reduce the number of possible candidates by adopting a known result from segmentation problems. We then show that for fixed bernoulli parameters we can find the optimal change point in logarithmic time. Finally, we show how to construct a candidate list of size $O(\epsilon^{-1} \log n)$ for model parameters. We demonstrate empirically the approximation quality and the running time of our algorithm, showing that we can gain a significant speed-up with a minimal average loss in optimality.

📄 PDF Abstract BibTeX arXiv:2301.08892

Code (0)

등록된 구현이 없습니다.

Tasks

Change DetectionChange Point Detection

Similar Papers 제목 키워드 기반

A Log-Linear Non-Parametric Online Changepoint Detection Algorithm based on Functional Pruning

2023-02-06 · Gaetano Romano, Idris A Eckley, Paul Fearnhead

Online changepoint detection aims to detect anomalies and changes in real-time in high-frequency data streams, sometimes with limited available computational resources. This is an important task that is rooted in many re…

Process Knowledge Driven Change Point Detection for Automated Calibration of Discrete Event Simulation Models Using Machine Learning

2020-05-11 · Suleyman Yildirim, Alper Ekrem Murat, Murat Yildirim, Suzan Arslanturk

Initial development and subsequent calibration of discrete event simulation models for complex systems require accurate identification of dynamically changing process characteristics. Existing data driven change point me…

Change Point DetectionTime SeriesTime Series Analysis

Population based change-point detection for the identification of homozygosity islands

2021-11-19 · Lucas Prates, Renan B Lemes, Tábita Hünemeier, Florencia Leonardi

In this paper, we propose a new method for offline change-point detection on some parameters of the distribution of a random vector. We introduce a penalized maximum likelihood approach that can be efficiently computed b…

Change Point Detection

High-dimensional, multiscale online changepoint detection

2020-03-07 · Yudong Chen, Tengyao Wang, Richard J. Samworth

We introduce a new method for high-dimensional, online changepoint detection in settings where a $p$-variate Gaussian data stream may undergo a change in mean. The procedure works by performing likelihood ratio tests aga…

Vocal Bursts Intensity Prediction

Online Centralized Non-parametric Change-point Detection via Graph-based Likelihood-ratio Estimation

2023-01-08 · Alejandro de la Concha, Argyris Kalogeratos, Nicolas Vayatis

Consider each node of a graph to be generating a data stream that is synchronized and observed at near real-time. At a change-point $\tau$, a change occurs at a subset of nodes $C$, which affects the probability distribu…

Change Point Detection