Class-incremental Learning for Time Series: Benchmark and Evaluation
Real-world environments are inherently non-stationary, frequently introducing new classes over time. This is especially common in time series classification, such as the emergence of new disease classification in healthcare or the addition of new activities in human activity recognition. In such cases, a learning system is required to assimilate novel classes effectively while avoiding catastrophic forgetting of the old ones, which gives rise to the Class-incremental Learning (CIL) problem. However, despite the encouraging progress in the image and language domains, CIL for time series data remains relatively understudied. Existing studies suffer from inconsistent experimental designs, necessitating a comprehensive evaluation and benchmarking of methods across a wide range of datasets. To this end, we first present an overview of the Time Series Class-incremental Learning (TSCIL) problem, highlight its unique challenges, and cover the advanced methodologies. Further, based on standardized settings, we develop a unified experimental framework that supports the rapid development of new algorithms, easy integration of new datasets, and standardization of the evaluation process. Using this framework, we conduct a comprehensive evaluation of various generic and time-series-specific CIL methods in both standard and privacy-sensitive scenarios. Our extensive experiments not only provide a standard baseline to support future research but also shed light on the impact of various design factors such as normalization layers or memory budget thresholds. Codes are available at https://github.com/zqiao11/TSCIL.
Code (1)
Tasks
Activity RecognitionBenchmarkingclass-incremental learningClass Incremental LearningHuman Activity RecognitionIncremental LearningTime SeriesTime Series ClassificationSimilar Papers 제목 키워드 기반
We Need a More Robust Classifier: Dual Causal Learning Empowers Domain-Incremental Time Series Classification
The World Wide Web thrives on intelligent services that rely on accurate time series classification, which has recently witnessed significant progress driven by advances in deep learning. However, existing studies face c…
Time Series ClassificationIncremental LearningCombining Statistical Features and Deep Encodings for Rehearsal-Based Class-Incremental Time Series Classification
Many systems used in real-world environments require adding new categories and incorporating new information without forgetting what was previously learnt by the classification model. This is known as class-incremental c…
Time Series ClassificationContinual LearningPTMs-TSCIL Pre-Trained Models Based Class-Incremental Learning
Class-incremental learning (CIL) for time series data faces critical challenges in balancing stability against catastrophic forgetting and plasticity for new knowledge acquisition, particularly under real-world constrain…
class-incremental learningClass Incremental LearningContinual LearningIncremental Learning+2Multiple-Kernel Dictionary Learning for Reconstruction and Clustering of Unseen Multivariate Time-series
There exist many approaches for description and recognition of unseen classes in datasets. Nevertheless, it becomes a challenging problem when we deal with multivariate time-series (MTS) (e.g., motion data), where we can…
ClusteringDictionary LearningOnline ClusteringTime Series+1Evaluating Temporal Plasticity in Foundation Time Series Models for Incremental Fine-tuning
Time series foundation models excel at diverse time series forecasting tasks, but their capacity for continuous improvement through incremental learning remains unexplored. We present the first comprehensive study invest…
Continual LearningIncremental LearningTime SeriesTime Series Forecasting