Dynamic Contrastive Learning for Time Series Representation
Understanding events in time series is an important task in a variety of contexts. However, human analysis and labeling are expensive and time-consuming. Therefore, it is advantageous to learn embeddings for moments in time series in an unsupervised way, which allows for good performance in classification or detection tasks after later minimal human labeling. In this paper, we propose dynamic contrastive learning (DynaCL), an unsupervised contrastive representation learning framework for time series that uses temporal adjacent steps to define positive pairs. DynaCL adopts N-pair loss to dynamically treat all samples in a batch as positive or negative pairs, enabling efficient training and addressing the challenges of complicated sampling of positives. We demonstrate that DynaCL embeds instances from time series into semantically meaningful clusters, which allows superior performance on downstream tasks on a variety of public time series datasets. Our findings also reveal that high scores on unsupervised clustering metrics do not guarantee that the representations are useful in downstream tasks.
Code (1)
Tasks
Contrastive LearningRepresentation LearningTime SeriesMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Contrastive Learning for Time Series on Dynamic Graphs
There have been several recent efforts towards developing representations for multivariate time-series in an unsupervised learning framework. Such representations can prove beneficial in tasks such as activity recognitio…
Activity RecognitionAnomaly DetectionContrastive LearningTime Series+1Contrastive Representation Learning for Predicting Solar Flares from Extremely Imbalanced Multivariate Time Series Data
Major solar flares are abrupt surges in the Sun's magnetic flux, presenting significant risks to technological infrastructure. In view of this, effectively predicting major flares from solar active region magnetic field …
Maximum SeparationRepresentation LearningSolar Flare PredictionTime Series+1Towards Enhancing Time Series Contrastive Learning: A Dynamic Bad Pair Mining Approach
Not all positive pairs are beneficial to time series contrastive learning. In this paper, we study two types of bad positive pairs that can impair the quality of time series representation learned through contrastive lea…
Contrastive LearningRepresentation LearningTime SeriesTime Series AnalysisMulti-Task Self-Supervised Time-Series Representation Learning
Time-series representation learning can extract representations from data with temporal dynamics and sparse labels. When labeled data are sparse but unlabeled data are abundant, contrastive learning, i.e., a framework to…
Anomaly DetectionContrastive LearningMulti-Task LearningRepresentation Learning+4Fuzzy Cluster-Aware Contrastive Clustering for Time Series
The rapid growth of unlabeled time series data, driven by the Internet of Things (IoT), poses significant challenges in uncovering underlying patterns. Traditional unsupervised clustering methods often fail to capture th…
ClusteringContrastive LearningData AugmentationRepresentation Learning+1