Attention to Warp: Deep Metric Learning for Multivariate Time Series
Deep time series metric learning is challenging due to the difficult trade-off between temporal invariance to nonlinear distortion and discriminative power in identifying non-matching sequences. This paper proposes a novel neural network-based approach for robust yet discriminative time series classification and verification. This approach adapts a parameterized attention model to time warping for greater and more adaptive temporal invariance. It is robust against not only local but also large global distortions, so that even matching pairs that do not satisfy the monotonicity, continuity, and boundary conditions can still be successfully identified. Learning of this model is further guided by dynamic time warping to impose temporal constraints for stabilized training and higher discriminative power. It can learn to augment the inter-class variation through warping, so that similar but different classes can be effectively distinguished. We experimentally demonstrate the superiority of the proposed approach over previous non-parametric and deep models by combining it with a deep online signature verification framework, after confirming its promising behavior in single-letter handwriting classification on the Unipen dataset.
Code (1)
Tasks
Dynamic Time WarpingMetric LearningTime SeriesTime Series AnalysisTime Series ClassificationSimilar Papers 제목 키워드 기반
Warped Dynamic Linear Models for Time Series of Counts
Dynamic Linear Models (DLMs) are commonly employed for time series analysis due to their versatile structure, simple recursive updating, ability to handle missing data, and probabilistic forecasting. However, the options…
Time SeriesTime Series AnalysisvalidWarpformer: A Multi-scale Modeling Approach for Irregular Clinical Time Series
Irregularly sampled multivariate time series are ubiquitous in various fields, particularly in healthcare, and exhibit two key characteristics: intra-series irregularity and inter-series discrepancy. Intra-series irregul…
Irregular Time SeriesRepresentation LearningTime SeriesRobust Augmentation for Multivariate Time Series Classification
Neural networks are capable of learning powerful representations of data, but they are susceptible to overfitting due to the number of parameters. This is particularly challenging in the domain of time series classificat…
ClassificationTime SeriesTime Series AnalysisTime Series ClassificationQuantum Dynamic Time Warping for Multivariate Time Series Classification
Dynamic Time Warping (DTW) is a cornerstone for time series classification, but its reliance on Euclidean distances fails to capture latent cross-channel correlations in complex multivariate data. We propose a hybrid Qua…
Time Series ClassificationUnsupervised Distance Metric Learning for Anomaly Detection Over Multivariate Time Series
Distance-based time series anomaly detection methods are prevalent due to their relative non-parametric nature and interpretability. However, the commonly used Euclidean distance is sensitive to noise. While existing wor…
Anomaly DetectionDynamic Time WarpingMetric LearningTime Series+1