Multimodal Meta-Learning for Time Series Regression
Recent work has shown the efficiency of deep learning models such as Fully Convolutional Networks (FCN) or Recurrent Neural Networks (RNN) to deal with Time Series Regression (TSR) problems. These models sometimes need a lot of data to be able to generalize, yet the time series are sometimes not long enough to be able to learn patterns. Therefore, it is important to make use of information across time series to improve learning. In this paper, we will explore the idea of using meta-learning for quickly adapting model parameters to new short-history time series by modifying the original idea of Model Agnostic Meta-Learning (MAML) \cite{finn2017model}. Moreover, based on prior work on multimodal MAML \cite{vuorio2019multimodal}, we propose a method for conditioning parameters of the model through an auxiliary network that encodes global information of the time series to extract meta-features. Finally, we apply the data to time series of different domains, such as pollution measurements, heart-rate sensors, and electrical battery data. We show empirically that our proposed meta-learning method learns TSR with few data fast and outperforms the baselines in 9 of 12 experiments.
Code (0)
등록된 구현이 없습니다.
Tasks
Meta-LearningregressionTime SeriesTime Series AnalysisTime Series RegressionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Meta-Forecasting by combining Global Deep Representations with Local Adaptation
While classical time series forecasting considers individual time series in isolation, recent advances based on deep learning showed that jointly learning from a large pool of related time series can boost the forecastin…
Meta-LearningTime SeriesTime Series AnalysisTime Series ForecastingMeta-Transformer: A Unified Framework for Multimodal Learning
Multimodal learning aims to build models that can process and relate information from multiple modalities. Despite years of development in this field, it still remains challenging to design a unified network for processi…
Time SeriesMoTime: A Dataset Suite for Multimodal Time Series Forecasting
While multimodal data sources are increasingly available from real-world forecasting, most existing research remains on unimodal time series. In this work, we present MoTime, a suite of multimodal time series forecasting…
Time SeriesTime Series ForecastingChronicle: A Multimodal Foundation Model for Joint Language and Time Series Understanding
Real-world time series come with text: metadata, descriptions, news, reports. Yet time series foundation models process numerical sequences in isolation, and the multimodal text-and-time-series models that attempt to bri…
Time Series ClassificationTwo-Step Meta-Learning for Time-Series Forecasting Ensemble
Amounts of historical data collected increase and business intelligence applicability with automatic forecasting of time series are in high demand. While no single time series modeling method is universal to all types of…
DiversityMeta-LearningTime SeriesTime Series Analysis+2