paper-with-me

홈 › Papers

DIVERSIFY: A General Framework for Time Series Out-of-distribution Detection and Generalization

2023-08-04 · Wang Lu, Jindong Wang, Xinwei Sun, Yiqiang Chen, Xiangyang Ji, Qiang Yang, Xing Xie

Time series remains one of the most challenging modalities in machine learning research. The out-of-distribution (OOD) detection and generalization on time series tend to suffer due to its non-stationary property, i.e., the distribution changes over time. The dynamic distributions inside time series pose great challenges to existing algorithms to identify invariant distributions since they mainly focus on the scenario where the domain information is given as prior knowledge. In this paper, we attempt to exploit subdomains within a whole dataset to counteract issues induced by non-stationary for generalized representation learning. We propose DIVERSIFY, a general framework, for OOD detection and generalization on dynamic distributions of time series. DIVERSIFY takes an iterative process: it first obtains the "worst-case" latent distribution scenario via adversarial training, then reduces the gap between these latent distributions. We implement DIVERSIFY via combining existing OOD detection methods according to either extracted features or outputs of models for detection while we also directly utilize outputs for classification. In addition, theoretical insights illustrate that DIVERSIFY is theoretically supported. Extensive experiments are conducted on seven datasets with different OOD settings across gesture recognition, speech commands recognition, wearable stress and affect detection, and sensor-based human activity recognition. Qualitative and quantitative results demonstrate that DIVERSIFY learns more generalized features and significantly outperforms other baselines.

📄 PDF Abstract BibTeX arXiv:2308.02282

Code (0)

등록된 구현이 없습니다.

Tasks

Activity RecognitionGesture RecognitionHuman Activity RecognitionOut-of-Distribution DetectionOut of Distribution (OOD) DetectionRepresentation LearningTime Series

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

DIVERSIFY to Generalize: Learning Generalized Representations for Time Series Classification

2021-09-29 · Wang Lu, Jindong Wang, Yiqiang Chen, Xinwei Sun

Time series classification is an important problem in real world. Due to its nonstationary property that the distribution changes over time, it remains challenging to build models for generalization to unseen distributio…

Activity RecognitionClassificationGesture RecognitionHuman Activity Recognition+3

Out-of-Distribution Representation Learning for Time Series Classification

2022-09-15 · Wang Lu, Jindong Wang, Xinwei Sun, Yiqiang Chen 외

Time series classification is an important problem in real world. Due to its non-stationary property that the distribution changes over time, it remains challenging to build models for generalization to unseen distributi…

Activity RecognitionClassificationGesture RecognitionHuman Activity Recognition+4

ForecastGrapher: Redefining Multivariate Time Series Forecasting with Graph Neural Networks

2024-05-28 · Wanlin Cai, Kun Wang, Hao Wu, Xiaoxu Chen 외

The challenge of effectively learning inter-series correlations for multivariate time series forecasting remains a substantial and unresolved problem. Traditional deep learning models, which are largely dependent on the …

Multivariate Time Series ForecastingNode RegressionTime SeriesTime Series Forecasting

Modeling the Q-Diversity in a Min-max Play Game for Robust Optimization

2023-05-20 · Ting Wu, Rui Zheng, Tao Gui, Qi Zhang 외

Models trained with empirical risk minimization (ERM) are revealed to easily rely on spurious correlations, resulting in poor generalization. Group distributionally robust optimization (group DRO) can alleviate this prob…

DiversityOut-of-Distribution Generalizationtext-classificationText Classification

DART: Diversify-Aggregate-Repeat Training Improves Generalization of Neural Networks

2023-02-28 · CVPR 2023 1 · Samyak Jain, Sravanti Addepalli, Pawan Sahu, Priyam Dey 외

Generalization of neural networks is crucial for deploying them safely in the real world. Common training strategies to improve generalization involve the use of data augmentations, ensembling and model averaging. In thi…

Domain Generalization