paper-with-me

Papers

Multi-view self-supervised learning for multivariate variable-channel time series

2023-07-13 · Thea Brüsch, Mikkel N. Schmidt, Tommy S. Alstrøm

Labeling of multivariate biomedical time series data is a laborious and expensive process. Self-supervised contrastive learning alleviates the need for large, labeled datasets through pretraining on unlabeled data. However, for multivariate time series data, the set of input channels often varies between applications, and most existing work does not allow for transfer between datasets with different sets of input channels. We propose learning one encoder to operate on all input channels individually. We then use a message passing neural network to extract a single representation across channels. We demonstrate the potential of this method by pretraining our model on a dataset with six EEG channels and then fine-tuning it on a dataset with two different EEG channels. We compare models with and without the message passing neural network across different contrastive loss functions. We show that our method, combined with the TS2Vec loss, outperforms all other methods in most settings.

📄 PDF Abstract BibTeX arXiv:2307.09614

Code (1)

theabrusch/multiview_ts_ssl 공식 구현 pytorch

Tasks

Contrastive LearningEEGSelf-Supervised LearningTime Series

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Beyond Marginals: Learning Joint Spatio-Temporal Patterns for Multivariate Anomaly Detection

2025-09-18 · Padmaksha Roy, Almuatazbellah Boker, Lamine Mili arxiv

In this paper, we aim to improve multivariate anomaly detection (AD) by modeling the \textit{time-varying non-linear spatio-temporal correlations} found in multivariate time series data . In multivariate time series data…

Contrastive LearningAnomaly Detection

A Co-analysis Framework for Exploring Multivariate Scientific Data

2019-08-19 · Xiangyang He, Yubo Tao, Qirui Wang, Hai Lin

In complex multivariate data sets, different features usually include diverse associations with different variables, and different variables are associated within different regions. Therefore, exploring the associations …

Diversity

HOPS: High-order Polynomials with Self-supervised Dimension Reduction for Load Forecasting

2025-01-18 · Pengyang Song, Han Feng, Shreyashi Shukla, Jue Wang 외

Load forecasting is a fundamental task in smart grid. Many techniques have been applied to developing load forecasting models. Due to the challenges such as the Curse of Dimensionality, overfitting, and limited computing…

Computational EfficiencyDimensionality ReductionLoad Forecasting

Structured Temporal Causality for Interpretable Multivariate Time Series Anomaly Detection

2025-10-18 · Dongchan Cho, Jiho Han, Keumyeong Kang, Minsang Kim 외 arxiv

Real-world multivariate time series anomalies are rare and often unlabeled. Additionally, prevailing methods rely on increasingly complex architectures tuned to benchmarks, detecting only fragments of anomalous segments …

Time Series Anomaly Detection

HOME: High-Order Mixed-Moment-based Embedding for Representation Learning

2022-07-15 · Chuang Niu, Ge Wang

Minimum redundancy among different elements of an embedding in a latent space is a fundamental requirement or major preference in representation learning to capture intrinsic informational structures. Current self-superv…

Linear evaluationRepresentation LearningSelf-Supervised LearningVocal Bursts Intensity Prediction