paper-with-me

홈 › Papers

Disentangled Generative Models for Robust Prediction of System Dynamics

2021-08-26 · Stathi Fotiadis, Mario Lino, Shunlong Hu, Stef Garasto, Chris D Cantwell, Anil Anthony Bharath

Deep neural networks have become increasingly of interest in dynamical system prediction, but out-of-distribution generalization and long-term stability still remains challenging. In this work, we treat the domain parameters of dynamical systems as factors of variation of the data generating process. By leveraging ideas from supervised disentanglement and causal factorization, we aim to separate the domain parameters from the dynamics in the latent space of generative models. In our experiments we model dynamics both in phase space and in video sequences and conduct rigorous OOD evaluations. Results indicate that disentangled VAEs adapt better to domain parameters spaces that were not present in the training data. At the same time, disentanglement can improve the long-term and out-of-distribution predictions of state-of-the-art models in video sequences.

📄 PDF Abstract BibTeX arXiv:2108.11684

Code (1)

stathius/sd-vae 공식 구현 pytorch

Tasks

DisentanglementOut-of-Distribution Generalization

Similar Papers 제목 키워드 기반

Disentangled State Space Representations

2019-06-07 · Đorđe Miladinović, Muhammad Waleed Gondal, Bernhard Schölkopf, Joachim M. Buhmann 외

Sequential data often originates from diverse domains across which statistical regularities and domain specifics exist. To specifically learn cross-domain sequence representations, we introduce disentangled state space m…

regressionState Space ModelsTransfer Learning

DISENTANGLED STATE SPACE MODELS: UNSUPERVISED LEARNING OF DYNAMICS ACROSS HETEROGENEOUS ENVIRONMENTS

2019-03-27 · ICLR Workshop DeepGenStruct 2019 · Ðorđe Miladinović, Waleed Gondal, Bernhard Schölkopf, Joachim M. Buhmann 외

Sequential data often originates from diverse environments. Across them exist both shared regularities and environment specifics. To learn robust cross-environment descriptions of sequences we introduce disentangled stat…

PredictionState Space Models

Learning Disentangled Representation in Object-Centric Models for Visual Dynamics Prediction via Transformers

2024-07-03 · Sanket Gandhi, Atul, Samanyu Mahajan, Vishal Sharma 외

Recent work has shown that object-centric representations can greatly help improve the accuracy of learning dynamics while also bringing interpretability. In this work, we take this idea one step further, ask the followi…

AttributeObject

Exploring Behavior-Relevant and Disentangled Neural Dynamics with Generative Diffusion Models

2024-10-12 · Yule Wang, Chengrui Li, Weihan Li, Anqi Wu

Understanding the neural basis of behavior is a fundamental goal in neuroscience. Current research in large-scale neuro-behavioral data analysis often relies on decoding models, which quantify behavioral information in n…

Disentanglement

Spatio-temporal Disentangled representation learning for mobility prediction

2021-09-29 · Sichen Zhao, Wei Shao, Jeffrey Chan, Flora D. Salim

Spatio-temporal (ST) prediction task like mobility forecasting is of great significance to traffic management and public safety. There is an increasing number of works proposed for mobility forecasting problems recently…

ManagementPredictionRepresentation Learning