Learning Discriminative Prototypes with Dynamic Time Warping
Dynamic Time Warping (DTW) is widely used for temporal data processing. However, existing methods can neither learn the discriminative prototypes of different classes nor exploit such prototypes for further analysis. We propose Discriminative Prototype DTW (DP-DTW), a novel method to learn class-specific discriminative prototypes for temporal recognition tasks. DP-DTW shows superior performance compared to conventional DTWs on time series classification benchmarks. Combined with end-to-end deep learning, DP-DTW can handle challenging weakly supervised action segmentation problems and achieves state of the art results on standard benchmarks. Moreover, detailed reasoning on the input video is enabled by the learned action prototypes. Specifically, an action-based video summarization can be obtained by aligning the input sequence with action prototypes.
Code (1)
Tasks
Action SegmentationDynamic Time WarpingTime SeriesTime Series AnalysisTime Series ClassificationVideo SummarizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Deep Attentive Time Warping
Similarity measures for time series are important problems for time series classification. To handle the nonlinear time distortions, Dynamic Time Warping (DTW) has been widely used. However, DTW is not learnable and suff…
Dynamic Time WarpingMetric LearningTime SeriesTime Series ClassificationTime Series Data Augmentation for Neural Networks by Time Warping with a Discriminative Teacher
Neural networks have become a powerful tool in pattern recognition and part of their success is due to generalization from using large datasets. However, unlike other domains, time series classification datasets are ofte…
Data AugmentationDynamic Time WarpingTime SeriesTime Series Analysis+1D3TW: Discriminative Differentiable Dynamic Time Warping for Weakly Supervised Action Alignment and Segmentation
We address weakly supervised action alignment and segmentation in videos, where only the order of occurring actions is available during training. We propose Discriminative Differentiable Dynamic Time Warping (D3TW), the …
Dynamic Time WarpingSegmentationWeakly Supervised Action Segmentation (Transcript)Attention to Warp: Deep Metric Learning for Multivariate Time Series
Deep time series metric learning is challenging due to the difficult trade-off between temporal invariance to nonlinear distortion and discriminative power in identifying non-matching sequences. This paper proposes a nov…
Dynamic Time WarpingMetric LearningTime SeriesTime Series Analysis+1ShapeDBA: Generating Effective Time Series Prototypes using ShapeDTW Barycenter Averaging
Time series data can be found in almost every domain, ranging from the medical field to manufacturing and wireless communication. Generating realistic and useful exemplars and prototypes is a fundamental data analysis ta…
ClusteringDynamic Time WarpingTime SeriesTime Series Analysis+1