User-friendly Foundation Model Adapters for Multivariate Time Series Classification
Foundation models, while highly effective, are often resource-intensive, requiring substantial inference time and memory. This paper addresses the challenge of making these models more accessible with limited computational resources by exploring dimensionality reduction techniques. Our goal is to enable users to run large pre-trained foundation models on standard GPUs without sacrificing performance. We investigate classical methods such as Principal Component Analysis alongside neural network-based adapters, aiming to reduce the dimensionality of multivariate time series data while preserving key features. Our experiments show up to a 10x speedup compared to the baseline model, without performance degradation, and enable up to 4.5x more datasets to fit on a single GPU, paving the way for more user-friendly and scalable foundation models.
Code (0)
등록된 구현이 없습니다.
Tasks
Dimensionality ReductionGPUTime SeriesTime Series ClassificationSimilar Papers 제목 키워드 기반
Mantis: Lightweight Calibrated Foundation Model for User-Friendly Time Series Classification
In recent years, there has been increasing interest in developing foundation models for time series data that can generalize across diverse downstream tasks. While numerous forecasting-oriented foundation models have bee…
Contrastive LearningTime SeriesTime Series ClassificationAdaPTS: Adapting Univariate Foundation Models to Probabilistic Multivariate Time Series Forecasting
Pre-trained foundation models (FMs) have shown exceptional performance in univariate time series forecasting tasks. However, several practical challenges persist, including managing intricate dependencies among features …
Multivariate Time Series ForecastingRepresentation LearningTime SeriesTime Series Forecasting+2The mbsts package: Multivariate Bayesian Structural Time Series Models in R
The multivariate Bayesian structural time series (MBSTS) model is a general machine learning model that deals with inference and prediction for multiple correlated time series, where one also has the choice of using a di…
feature selectionTime SeriesTime Series AnalysisTime Series ForecastingLoREnc: Low-Rank Encryption for Securing Foundation Models and LoRA Adapters
Foundation models and low-rank adapters enable efficient on-device generative AI but raise risks such as intellectual property leakage and model recovery attacks. Existing defenses are often impractical because they requ…
A Framework for Double-Blind Federated Adaptation of Foundation Models
The availability of foundational models (FMs) pre-trained on large-scale data has advanced the state-of-the-art in many computer vision tasks. While FMs have demonstrated good zero-shot performance on many image classifi…
Federated Learningimage-classificationImage ClassificationKnowledge Distillation+2