Hidden Parameter Recurrent State Space Models For Changing Dynamics Scenarios
Recurrent State-space models (RSSMs) are highly expressive models for learning patterns in time series data and system identification. However, these models assume that the dynamics are fixed and unchanging, which is rarely the case in real-world scenarios. Many control applications often exhibit tasks with similar but not identical dynamics which can be modeled as a latent variable. We introduce the Hidden Parameter Recurrent State Space Models (HiP-RSSMs), a framework that parametrizes a family of related dynamical systems with a low-dimensional set of latent factors. We present a simple and effective way of learning and performing inference over this Gaussian graphical model that avoids approximations like variational inference. We show that HiP-RSSMs outperforms RSSMs and competing multi-task models on several challenging robotic benchmarks both on real-world systems and simulations.
Code (1)
Tasks
State Space ModelsTime SeriesTime Series AnalysisVariational InferenceSimilar Papers 제목 키워드 기반
Sparsely Changing Latent States for Prediction and Planning in Partially Observable Domains
A common approach to prediction and planning in partially observable domains is to use recurrent neural networks (RNNs), which ideally develop and maintain a latent memory about hidden, task-relevant factors. We hypothes…
Inductive BiasSeq103: A Unified Neuroevolution Framework for Compact Sequence Architecture Discovery
Neuroevolution is a representative neural architecture search paradigm that evolves both network topology and weights through evolutionary algorithms. In this paper, we propose Seq103, a unified NEAT-style neuroevolution…
Neural Architecture SearchText ClassificationLongSSM: On the Length Extension of State-space Models in Language Modelling
In this paper, we investigate the length-extension of state-space models (SSMs) in language modeling. Length extension involves training models on short sequences and testing them on longer ones. We show that state-space…
Language ModelingLanguage ModellingState Space ModelsLearning and Understanding a Disentangled Feature Representation for Hidden Parameters in Reinforcement Learning
Hidden parameters are latent variables in reinforcement learning (RL) environments that are constant over the course of a trajectory. Understanding what, if any, hidden parameters affect a particular environment can aid …
Metric Learningreinforcement-learningReinforcement Learning (RL)Contextual Recurrent Neural Networks
There is an implicit assumption that by unfolding recurrent neural networks (RNN) in finite time, the misspecification of choosing a zero value for the initial hidden state is mitigated by later time steps. This assumpti…
Retrieval