paper-with-me

Papers

Meta-Learning Dynamics Forecasting Using Task Inference

2021-02-20 · Rui Wang, Robin Walters, Rose Yu

Current deep learning models for dynamics forecasting struggle with generalization. They can only forecast in a specific domain and fail when applied to systems with different parameters, external forces, or boundary conditions. We propose a model-based meta-learning method called DyAd which can generalize across heterogeneous domains by partitioning them into different tasks. DyAd has two parts: an encoder which infers the time-invariant hidden features of the task with weak supervision, and a forecaster which learns the shared dynamics of the entire domain. The encoder adapts and controls the forecaster during inference using adaptive instance normalization and adaptive padding. Theoretically, we prove that the generalization error of such procedure is related to the task relatedness in the source domain, as well as the domain differences between source and target. Experimentally, we demonstrate that our model outperforms state-of-the-art approaches on both turbulent flow and real-world ocean data forecasting tasks.

📄 PDF Abstract BibTeX arXiv:2102.10271

Code (1)

rose-stl-lab/dynamic-adaptation-network 공식 구현 pytorch

Tasks

Meta-Learning

Methods 이 논문이 사용한 방법론

Adaptive Instance Normalization 설명 없음
Instance Normalization Instance Normalization (also known as contrast normalization) is a normalization layer where: $$ y_{tijk} = \frac{x_{tijk} - \mu_{ti}}{\sqrt{\sigma_{ti}^2 +…

Similar Papers 제목 키워드 기반

Sequential Latent Variable Models for Few-Shot High-Dimensional Time-Series Forecasting

2023-05-05 · ICLR 2023 5 · Xiajun Jiang, Ryan Missel, Zhiyuan Li, Linwei Wang

Modern applications increasingly require learning and forecasting latent dynamics from high-dimensional time-series. Compared to univariate time-series forecasting, this adds a new challenge of reasoning about the latent…

Meta-LearningTime SeriesTime Series ForecastingUnivariate Time Series Forecasting

Tailored Forecasting from Short Time Series via Meta-learning

2025-01-27 · Declan A. Norton, Edward Ott, Andrew Pomerance, Brian Hunt 외

Machine learning (ML) models can be effective for forecasting the dynamics of unknown systems from time-series data, but they often require large amounts of data and struggle to generalize across systems with varying dyn…

Meta-LearningTime Series

Automatic Forecasting via Meta-Learning

2021-09-29 · Mustafa Abdallah, Ryan Rossi, Kanak Mahadik, Sungchul Kim 외

In this work, we develop techniques for fast automatic selection of the best forecasting model for a new unseen time-series dataset, without having to first train (or evaluate) all the models on the new time-series data …

Meta-LearningTime SeriesTime Series AnalysisTime Series Forecasting

Comparative Evaluation of Metaheuristic Algorithms for Hyperparameter Selection in Short-Term Weather Forecasting

2023-09-05 · Anuvab Sen, Arul Rhik Mazumder, Dibyarup Dutta, Udayon Sen 외

Weather forecasting plays a vital role in numerous sectors, but accurately capturing the complex dynamics of weather systems remains a challenge for traditional statistical models. Apart from Auto Regressive time forecas…

global-optimizationMetaheuristic OptimizationWeather Forecasting

Social Processes: Probabilistic Meta-learning for Adaptive Multiparty Interaction Forecasting

2025-01-03 · Augustinas Jučas, Chirag Raman

Adaptively forecasting human behavior in social settings is an important step toward achieving Artificial General Intelligence. Most existing research in social forecasting has focused either on unfocused interactions, s…

Human Behavior ForecastingMeta-LearningPedestrian Trajectory PredictionTrajectory Prediction