Time-Series Representation Learning via Temporal and Contextual Contrasting
Learning decent representations from unlabeled time-series data with temporal dynamics is a very challenging task. In this paper, we propose an unsupervised Time-Series representation learning framework via Temporal and Contextual Contrasting (TS-TCC), to learn time-series representation from unlabeled data. First, the raw time-series data are transformed into two different yet correlated views by using weak and strong augmentations. Second, we propose a novel temporal contrasting module to learn robust temporal representations by designing a tough cross-view prediction task. Last, to further learn discriminative representations, we propose a contextual contrasting module built upon the contexts from the temporal contrasting module. It attempts to maximize the similarity among different contexts of the same sample while minimizing similarity among contexts of different samples. Experiments have been carried out on three real-world time-series datasets. The results manifest that training a linear classifier on top of the features learned by our proposed TS-TCC performs comparably with the supervised training. Additionally, our proposed TS-TCC shows high efficiency in few-labeled data and transfer learning scenarios. The code is publicly available at https://github.com/emadeldeen24/TS-TCC.
Code (2)
Tasks
Automatic Sleep Stage ClassificationContrastive LearningEpilepsy PredictionFault DetectionRecognizing And Localizing Human ActionsRepresentation LearningSelf-Supervised LearningTime SeriesTime Series AnalysisTime Series ClassificationTransfer LearningSimilar Papers 제목 키워드 기반
Self-supervised Contrastive Representation Learning for Semi-supervised Time-Series Classification
Learning time-series representations when only unlabeled data or few labeled samples are available can be a challenging task. Recently, contrastive self-supervised learning has shown great improvement in extracting usefu…
Contrastive LearningData AugmentationLinear evaluationRepresentation Learning+6Graph-Aware Contrasting for Multivariate Time-Series Classification
Contrastive learning, as a self-supervised learning paradigm, becomes popular for Multivariate Time-Series (MTS) classification. It ensures the consistency across different views of unlabeled samples and then learns effe…
ClassificationContrastive LearningSelf-Supervised LearningTime Series+1United We Pretrain, Divided We Fail! Representation Learning for Time Series by Pretraining on 75 Datasets at Once
In natural language processing and vision, pretraining is utilized to learn effective representations. Unfortunately, the success of pretraining does not easily carry over to time series due to potential mismatch between…
Representation LearningTime SeriesMultimodal Physiological Signals Representation Learning via Multiscale Contrasting for Depression Recognition
Depression recognition based on physiological signals such as functional near-infrared spectroscopy (fNIRS) and electroencephalogram (EEG) has made considerable progress. However, most existing studies ignore the complem…
Data AugmentationEEGElectroencephalogram (EEG)Representation Learning+2Soft Contrastive Learning for Time Series
Contrastive learning has shown to be effective to learn representations from time series in a self-supervised way. However, contrasting similar time series instances or values from adjacent timestamps within a time serie…
Anomaly DetectionContrastive LearningTime SeriesTransfer Learning