Unsupervised Representation Learning for Time Series with Temporal Neighborhood Coding
Time series are often complex and rich in information but sparsely labeled and therefore challenging to model. In this paper, we propose a self-supervised framework for learning generalizable representations for non-stationary time series. Our approach, called Temporal Neighborhood Coding (TNC), takes advantage of the local smoothness of a signal's generative process to define neighborhoods in time with stationary properties. Using a debiased contrastive objective, our framework learns time series representations by ensuring that in the encoding space, the distribution of signals from within a neighborhood is distinguishable from the distribution of non-neighboring signals. Our motivation stems from the medical field, where the ability to model the dynamic nature of time series data is especially valuable for identifying, tracking, and predicting the underlying patients' latent states in settings where labeling data is practically impossible. We compare our method to recently developed unsupervised representation learning approaches and demonstrate superior performance on clustering and classification tasks for multiple datasets.
Code (2)
Tasks
ClusteringRepresentation LearningTime SeriesTime Series AnalysisSimilar Papers 제목 키워드 기반
Unsupervised 4D LiDAR Moving Object Segmentation in Stationary Settings with Multivariate Occupancy Time Series
In this work, we address the problem of unsupervised moving object segmentation (MOS) in 4D LiDAR data recorded from a stationary sensor, where no ground truth annotations are involved. Deep learning-based state-of-the-a…
ClusteringSemantic SegmentationTime SeriesTime Series Analysis+1Contrastive Learning for Time Series on Dynamic Graphs
There have been several recent efforts towards developing representations for multivariate time-series in an unsupervised learning framework. Such representations can prove beneficial in tasks such as activity recognitio…
Activity RecognitionAnomaly DetectionContrastive LearningTime Series+1VISTA: Unsupervised 2D Temporal Dependency Representations for Time Series Anomaly Detection
Time Series Anomaly Detection (TSAD) is essential for uncovering rare and potentially harmful events in unlabeled time series data. Existing methods are highly dependent on clean, high-quality inputs, making them suscept…
Anomaly DetectionTime SeriesTime Series Anomaly DetectionLearning Representations for Time Series Clustering
Time series clustering is an essential unsupervised technique in cases when category information is not available. It has been widely applied to genome data, anomaly detection, and in general, in any domain where pattern…
Anomaly DetectionClusteringOpen-Ended Question AnsweringRepresentation Learning+3Unsupervised Deep Learning for IoT Time Series
IoT time series analysis has found numerous applications in a wide variety of areas, ranging from health informatics to network security. Nevertheless, the complex spatial temporal dynamics and high dimensionality of IoT…
Anomaly DetectionClusteringDeep LearningRepresentation Learning+3