Efficient High-Resolution Time Series Classification via Attention Kronecker Decomposition
The high-resolution time series classification problem is essential due to the increasing availability of detailed temporal data in various domains. To tackle this challenge effectively, it is imperative that the state-of-the-art attention model is scalable to accommodate the growing sequence lengths typically encountered in high-resolution time series data, while also demonstrating robustness in handling the inherent noise prevalent in such datasets. To address this, we propose to hierarchically encode the long time series into multiple levels based on the interaction ranges. By capturing relationships at different levels, we can build more robust, expressive, and efficient models that are capable of capturing both short-term fluctuations and long-term trends in the data. We then propose a new time series transformer backbone (KronTime) by introducing Kronecker-decomposed attention to process such multi-level time series, which sequentially calculates attention from the lower level to the upper level. Experiments on four long time series datasets demonstrate superior classification results with improved efficiency compared to baseline methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Time SeriesTime Series ClassificationSimilar Papers 제목 키워드 기반
MedGNN: Towards Multi-resolution Spatiotemporal Graph Learning for Medical Time Series Classification
Medical time series has been playing a vital role in real-world healthcare systems as valuable information in monitoring health conditions of patients. Accurate classification for medical time series, e.g., Electrocardio…
Electrocardiography (ECG)Graph LearningTime SeriesTime Series ClassificationEfficient Hierarchical Contrastive Self-supervising Learning for Time Series Classification via Importance-aware Resolution Selection
Recently, there has been a significant advancement in designing Self-Supervised Learning (SSL) frameworks for time series data to reduce the dependency on data labels. Among these works, hierarchical contrastive learning…
Contrastive LearningSelf-Supervised LearningTime SeriesTime Series ClassificationTimeMixer++: A General Time Series Pattern Machine for Universal Predictive Analysis
Time series analysis plays a critical role in numerous applications, supporting tasks such as forecasting, classification, anomaly detection, and imputation. In this work, we present the time series pattern machine (TSPM…
Anomaly DetectionImputationTime SeriesTime Series AnalysisSRT: Super-Resolution for Time Series via Disentangled Rectified Flow
Fine-grained time series data with high temporal resolution is critical for accurate analytics across a wide range of applications. However, the acquisition of such data is often limited by cost and feasibility. This pro…
Image Super-ResolutionSatellite Image Time Series Classification with Pixel-Set Encoders and Temporal Self-Attention
Satellite image time series, bolstered by their growing availability, are at the forefront of an extensive effort towards automated Earth monitoring by international institutions. In particular, large-scale control of ag…
General ClassificationTime SeriesTime Series AnalysisTime Series Classification