(Quasi)Periodicity Quantification in Video Data, Using Topology
This work introduces a novel framework for quantifying the presence and strength of recurrent dynamics in video data. Specifically, we provide continuous measures of periodicity (perfect repetition) and quasiperiodicity (superposition of periodic modes with non-commensurate periods), in a way which does not require segmentation, training, object tracking or 1-dimensional surrogate signals. Our methodology operates directly on video data. The approach combines ideas from nonlinear time series analysis (delay embeddings) and computational topology (persistent homology), by translating the problem of finding recurrent dynamics in video data, into the problem of determining the circularity or toroidality of an associated geometric space. Through extensive testing, we show the robustness of our scores with respect to several noise models/levels, we show that our periodicity score is superior to other methods when compared to human-generated periodicity rankings, and furthermore, we show that our quasiperiodicity score clearly indicates the presence of biphonation in videos of vibrating vocal folds, which has never before been accomplished end to end quantitatively.
Code (1)
Tasks
Object TrackingTime SeriesTime Series AnalysisSimilar Papers 제목 키워드 기반
Separation and Estimation of Periodic/Aperiodic State
Periodicity and aperiodicity can exist in a state simultaneously and typically become quasi-periodicity and quasi-aperiodicity in a dynamically changing state. The quasi-periodic and quasi-aperiodic states existing in th…
Spectral Transformer Neural Processes
Time series, spatial data, and images are natural applications of Neural Processes. However, when such data exhibit strong periodicity and quasi-periodicity, existing methods often suffer from underfitting and generalise…
Time-varying rPPG signal separation via block-sparse signal model
Remote photoplethysmography (rPPG) enables non-contact measurement of cardiac pulse signals by analyzing subtle color changes in facial videos. Nevertheless, extracting rPPG signals remains challenging because of their e…
From Fourier to Koopman: Spectral Methods for Long-term Time Series Prediction
We propose spectral methods for long-term forecasting of temporal signals stemming from linear and nonlinear quasi-periodic dynamical systems. For linear signals, we introduce an algorithm with similarities to the Fourie…
Time SeriesTime Series AnalysisTime Series PredictionUncertainty QuantificationUncertainty Quantification for Scientific Machine Learning using Sparse Variational Gaussian Process Kolmogorov-Arnold Networks (SVGP KAN)
Kolmogorov-Arnold Networks have emerged as interpretable alternatives to traditional multi-layer perceptrons. However, standard implementations lack principled uncertainty quantification capabilities essential for many s…
Out-of-Distribution DetectionBayesian Inference