Not All Data are Good Labels: On the Self-supervised Labeling for Time Series Forecasting
Time Series Forecasting (TSF) is a crucial task in various domains, yet existing TSF models rely heavily on high-quality data and insufficiently exploit all available data. This paper explores a novel self-supervised approach to re-label time series datasets by inherently constructing candidate datasets. During the optimization of a simple reconstruction network, intermediates are used as pseudo labels in a self-supervised paradigm, improving generalization for any predictor. We introduce the Self-Correction with Adaptive Mask (SCAM), which discards overfitted components and selectively replaces them with pseudo labels generated from reconstructions. Additionally, we incorporate Spectral Norm Regularization (SNR) to further suppress overfitting from a loss landscape perspective. Our experiments on eleven real-world datasets demonstrate that SCAM consistently improves the performance of various backbone models. This work offers a new perspective on constructing datasets and enhancing the generalization of TSF models through self-supervised learning.
Code (0)
등록된 구현이 없습니다.
Tasks
AllSelf-Supervised LearningTime SeriesTime Series ForecastingSimilar Papers 제목 키워드 기반
Automatic segmentation of meniscus based on MAE self-supervision and point-line weak supervision paradigm
Medical image segmentation based on deep learning is often faced with the problems of insufficient datasets and long time-consuming labeling. In this paper, we introduce the self-supervised method MAE(Masked Autoencoders…
Image SegmentationMedical Image SegmentationPseudo LabelSegmentation+1A formal approach to good practices in Pseudo-Labeling for Unsupervised Domain Adaptive Re-Identification
The use of pseudo-labels prevails in order to tackle Unsupervised Domain Adaptive (UDA) Re-Identification (re-ID) with the best performance. Indeed, this family of approaches has given rise to several UDA re-ID specific …
Learning from Scale-Invariant Examples for Domain Adaptation in Semantic Segmentation
Self-supervised learning approaches for unsupervised domain adaptation (UDA) of semantic segmentation models suffer from challenges of predicting and selecting reasonable good quality pseudo labels. In this paper, we pro…
Domain AdaptationImage-to-Image TranslationSegmentationSelf-Supervised Learning+3ESL: Entropy-guided Self-supervised Learning for Domain Adaptation in Semantic Segmentation
While fully-supervised deep learning yields good models for urban scene semantic segmentation, these models struggle to generalize to new environments with different lighting or weather conditions for instance. In additi…
Domain AdaptationSelf-Supervised LearningSemantic SegmentationUnsupervised Domain AdaptationSoft Self-labeling and Potts Relaxations for Weakly-Supervised Segmentation
We consider weakly supervised segmentation where only a fraction of pixels have ground truth labels (scribbles) and focus on a self-labeling approach optimizing relaxations of the standard unsupervised CRF/Potts loss on …