Optimal Change-Point Detection with Training Sequences in the Large and Moderate Deviations Regimes
This paper investigates a novel offline change-point detection problem from an information-theoretic perspective. In contrast to most related works, we assume that the knowledge of the underlying pre- and post-change distributions are not known and can only be learned from the training sequences which are available. We further require the probability of the \emph{estimation error} to decay either exponentially or sub-exponentially fast (corresponding respectively to the large and moderate deviations regimes in information theory parlance). Based on the training sequences as well as the test sequence consisting of a single change-point, we design a change-point estimator and further show that this estimator is optimal by establishing matching (strong) converses. This leads to a full characterization of the optimal confidence width (i.e., half the width of the confidence interval within which the true change-point is located at with high probability) as a function of the undetected error, under both the large and moderate deviations regimes.
Code (0)
등록된 구현이 없습니다.
Tasks
Change Point DetectionSimilar Papers 제목 키워드 기반
Learning Penalty for Optimal Partitioning via Automatic Feature Extraction
Changepoint detection identifies significant shifts in data sequences, making it important in areas like finance, genetics, and healthcare. The Optimal Partitioning algorithms efficiently detect these changes, using a pe…
Labeled Optimal Partitioning
In data sequences measured over space or time, an important problem is accurate detection of abrupt changes. In partially labeled data, it is important to correctly predict presence/absence of changes in positive/negativ…
Learning Sinkhorn divergences for supervised change point detection
Many modern applications require detecting change points in complex sequential data. Most existing methods for change point detection are unsupervised and, as a consequence, lack any information regarding what kind of ch…
Change DetectionChange Point Detectionfeature selectionEnhancing Changepoint Detection: Penalty Learning through Deep Learning Techniques
Changepoint detection, a technique for identifying significant shifts within data sequences, is crucial in various fields such as finance, genomics, medicine, etc. Dynamic programming changepoint detection algorithms are…
Deep LearningDeep learning model solves change point detection for multiple change types
A change points detection aims to catch an abrupt disorder in data distribution. Common approaches assume that there are only two fixed distributions for data: one before and another after a change point. Real-world data…
BenchmarkingChange Point Detection