TS2Vec: Towards Universal Representation of Time Series
This paper presents TS2Vec, a universal framework for learning representations of time series in an arbitrary semantic level. Unlike existing methods, TS2Vec performs contrastive learning in a hierarchical way over augmented context views, which enables a robust contextual representation for each timestamp. Furthermore, to obtain the representation of an arbitrary sub-sequence in the time series, we can apply a simple aggregation over the representations of corresponding timestamps. We conduct extensive experiments on time series classification tasks to evaluate the quality of time series representations. As a result, TS2Vec achieves significant improvement over existing SOTAs of unsupervised time series representation on 125 UCR datasets and 29 UEA datasets. The learned timestamp-level representations also achieve superior results in time series forecasting and anomaly detection tasks. A linear regression trained on top of the learned representations outperforms previous SOTAs of time series forecasting. Furthermore, we present a simple way to apply the learned representations for unsupervised anomaly detection, which establishes SOTA results in the literature. The source code is publicly available at https://github.com/yuezhihan/ts2vec.
Code (4)
Tasks
Anomaly DetectionContrastive LearningTime SeriesTime Series AnalysisTime Series ClassificationTime Series ForecastingUnsupervised Anomaly DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
General Time-series Model for Universal Knowledge Representation of Multivariate Time-Series data
Universal knowledge representation is a central problem for multivariate time series(MTS) foundation models and yet remains open. This paper investigates this problem from the first principle and it makes four folds of c…
Anomaly DetectionImputationTime SeriesTime Series AnalysisPath Signatures on Lie Groups
Path signatures are powerful nonparametric tools for time series analysis, shown to form a universal and characteristic feature map for Euclidean valued time series data. We lift the theory of path signatures to the sett…
Action RecognitionTemporal Action LocalizationTime SeriesTime Series AnalysisUniversal Time-Series Representation Learning: A Survey
Time-series data exists in every corner of real-world systems and services, ranging from satellites in the sky to wearable devices on human bodies. Learning representations by extracting and inferring valuable informatio…
Feature EngineeringRepresentation LearningSurveyTime SeriesAre Synthetic Time-series Data Really not as Good as Real Data?
Time-series data presents limitations stemming from data quality issues, bias and vulnerabilities, and generalization problem. Integrating universal data synthesis methods holds promise in improving generalization. Howev…
Representation LearningTime SeriesTimesURL: Self-supervised Contrastive Learning for Universal Time Series Representation Learning
Learning universal time series representations applicable to various types of downstream tasks is challenging but valuable in real applications. Recently, researchers have attempted to leverage the success of self-superv…
Anomaly DetectionContrastive LearningImputationRepresentation Learning+2