Semi-supervised Time Series Classification by Temporal Relation Prediction
Semi-supervised learning (SSL) has proven to be a powerful algorithm in different domains by leveraging unlabeled data to mitigate the reliance on the tremendous annotated data. However, few efforts consider the underlying temporal relation structure of unlabeled time series data in the semi-supervised learning paradigm. In this work, we propose a simple and effective method of Semi-supervised Time series classification architecture (termed as SemiTime) by gaining from the structure of unlabeled data in a self-supervised manner. Specifically, for the labeled time series, SemiTime conducts the supervised classification directly under the supervision of the annotated class label. For the unlabeled time series, the segments of past-future pair are sampled from time series, where two segments of pair from the same time series candidate are in positive temporal relation, while two segments from the different candidates are in negative temporal relation. Then, the temporal relation between those segments is predicted by SemiTime in a self-supervised manner. Finally, by jointly classifying labeled data and predicting the temporal relation of unlabeled data, the useful representation of unlabeled time series can be captured by SemiTime. Extensive experiments on multiple real-world datasets show that SemiTime consistently outperforms the state-of-the-arts, which demonstrates the effectiveness of the proposed method.
Code (1)
Tasks
ClassificationPredictionRelationRelation PredictionSemi-supervised time series classificationTime SeriesTime Series AnalysisTime Series ClassificationSimilar Papers 제목 키워드 기반
SMATE: Semi-Supervised Spatio-Temporal Representation Learning on Multivariate Time Series
Learning from Multivariate Time Series (MTS) has attracted widespread attention in recent years. In particular, label shortage is a real challenge for the classification task on MTS, considering its complex dimensional a…
Representation LearningTime SeriesTime Series AnalysisrETF-semiSL: Semi-Supervised Learning for Neural Collapse in Temporal Data
Deep neural networks for time series must capture complex temporal patterns, to effectively represent dynamic data. Self- and semi-supervised learning methods show promising results in pre-training large models, which --…
Time Series ClassificationGenerative Pre-Training of Time-Series Data for Unsupervised Fault Detection in Semiconductor Manufacturing
This paper introduces TRACE-GPT, which stands for Time-seRies Anomaly-detection with Convolutional Embedding and Generative Pre-trained Transformers. TRACE-GPT is designed to pre-train univariate time-series sensor data …
Anomaly DetectionFault DetectionTime SeriesTime Series Anomaly Detection+1Deep Semi-Supervised Learning for Time Series Classification
While Semi-supervised learning has gained much attention in computer vision on image data, yet limited research exists on its applicability in the time series domain. In this work, we investigate the transferability of s…
ClassificationData AugmentationGeneral ClassificationTime Series+2Self-supervised Contrastive Representation Learning for Semi-supervised Time-Series Classification
Learning time-series representations when only unlabeled data or few labeled samples are available can be a challenging task. Recently, contrastive self-supervised learning has shown great improvement in extracting usefu…
Contrastive LearningData AugmentationLinear evaluationRepresentation Learning+6