Multi-view self-supervised learning for multivariate variable-channel time series
Labeling of multivariate biomedical time series data is a laborious and expensive process. Self-supervised contrastive learning alleviates the need for large, labeled datasets through pretraining on unlabeled data. However, for multivariate time series data, the set of input channels often varies between applications, and most existing work does not allow for transfer between datasets with different sets of input channels. We propose learning one encoder to operate on all input channels individually. We then use a message passing neural network to extract a single representation across channels. We demonstrate the potential of this method by pretraining our model on a dataset with six EEG channels and then fine-tuning it on a dataset with two different EEG channels. We compare models with and without the message passing neural network across different contrastive loss functions. We show that our method, combined with the TS2Vec loss, outperforms all other methods in most settings.
Code (1)
Tasks
Contrastive LearningEEGSelf-Supervised LearningTime SeriesMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Beyond Marginals: Learning Joint Spatio-Temporal Patterns for Multivariate Anomaly Detection
In this paper, we aim to improve multivariate anomaly detection (AD) by modeling the \textit{time-varying non-linear spatio-temporal correlations} found in multivariate time series data . In multivariate time series data…
Contrastive LearningAnomaly DetectionA Co-analysis Framework for Exploring Multivariate Scientific Data
In complex multivariate data sets, different features usually include diverse associations with different variables, and different variables are associated within different regions. Therefore, exploring the associations …
DiversityHOPS: High-order Polynomials with Self-supervised Dimension Reduction for Load Forecasting
Load forecasting is a fundamental task in smart grid. Many techniques have been applied to developing load forecasting models. Due to the challenges such as the Curse of Dimensionality, overfitting, and limited computing…
Computational EfficiencyDimensionality ReductionLoad ForecastingStructured Temporal Causality for Interpretable Multivariate Time Series Anomaly Detection
Real-world multivariate time series anomalies are rare and often unlabeled. Additionally, prevailing methods rely on increasingly complex architectures tuned to benchmarks, detecting only fragments of anomalous segments …
Time Series Anomaly DetectionHOME: High-Order Mixed-Moment-based Embedding for Representation Learning
Minimum redundancy among different elements of an embedding in a latent space is a fundamental requirement or major preference in representation learning to capture intrinsic informational structures. Current self-superv…
Linear evaluationRepresentation LearningSelf-Supervised LearningVocal Bursts Intensity Prediction