paper-with-me

홈 › Papers

TS2Vec-Ensemble: An Enhanced Self-Supervised Framework for Time Series Forecasting

2025-11-27 · Ganeshan Niroshan, Uthayasanker Thayasivam arxiv

Self-supervised representation learning, particularly through contrastive methods like TS2Vec, has advanced the analysis of time series data. However, these models often falter in forecasting tasks because their objective functions prioritize instance discrimination over capturing the deterministic patterns, such as seasonality and trend, that are critical for accurate prediction. This paper introduces TS2Vec-Ensemble, a novel hybrid framework designed to bridge this gap. Our approach enhances the powerful, implicitly learned dynamics from a pretrained TS2Vec encoder by fusing them with explicit, engineered time features that encode periodic cycles. This fusion is achieved through a dual-model ensemble architecture, where two distinct regression heads -- one focused on learned dynamics and the other on seasonal patterns -- are combined using an adaptive weighting scheme. The ensemble weights are optimized independently for each forecast horizon, allowing the model to dynamically prioritize short-term dynamics or long-term seasonality as needed. We conduct extensive experiments on the ETT benchmark datasets for both univariate and multivariate forecasting. The results demonstrate that TS2Vec-Ensemble consistently and significantly outperforms the standard TS2Vec baseline and other state-of-the-art models, validating our hypothesis that a hybrid of learned representations and explicit temporal priors is a superior strategy for long-horizon time series forecasting.

📄 PDF Abstract BibTeX arXiv:2511.22395

Code (0)

등록된 구현이 없습니다.

Tasks

Time Series ForecastingRepresentation Learning

Similar Papers 제목 키워드 기반

Perceptual Loss based Speech Denoising with an ensemble of Audio Pattern Recognition and Self-Supervised Models

2020-10-22

Deep learning based speech denoising still suffers from the challenge of improving perceptual quality of enhanced signals. We introduce a generalized framework called Perceptual Ensemble Regularization Loss (PERL) built …

DenoisingEmotion ClassificationMulti-Task LearningSpeech Denoising

A Novel Ensemble Learning Approach to Unsupervised Record Linkage

2017-11-01 · Anna Jurek, Jun Hong, Yuan Chi, Weiru Liu

Record linkage is a process of identifying records that refer to the same real-world entity. Many existing approaches to record linkage apply supervised machine learning techniques to generate a classification model that…

Active LearningDiversityEnsemble LearningSelf-Learning

Enhanced Few-Shot Class-Incremental Learning via Ensemble Models

2024-01-14 · Mingli Zhu, Zihao Zhu, Sihong Chen, Chen Chen 외

Few-shot class-incremental learning (FSCIL) aims to continually fit new classes with limited training data, while maintaining the performance of previously learned classes. The main challenges are overfitting the rare ne…

class-incremental learningClass Incremental LearningData AugmentationFew-Shot Class-Incremental Learning+2

Semi-Supervised Learning with Online Knowledge Distillation for Skin Lesion Classification

2025-08-15 · Siyamalan Manivannan arxiv

Deep Learning has emerged as a promising approach for skin lesion analysis. However, existing methods mostly rely on fully supervised learning, requiring extensive labeled data, which is challenging and costly to obtain.…

Skin Lesion ClassificationKnowledge DistillationEnsemble Learning

Ensemble Self-Training for Unsupervised Machine Translation

2026-03-17 · Ido Aharon, Jonathan Shaki, Sarit Kraus arxiv

We present an ensemble-driven self-training framework for unsupervised neural machine translation (UNMT). Starting from a primary language pair, we train multiple UNMT models that share the same translation task but diff…

Unsupervised Machine Translation