paper-with-me

Papers

Hidden Parameter Recurrent State Space Models For Changing Dynamics Scenarios

2022-06-29 · ICLR 2022 4 · Vaisakh Shaj, Dieter Buchler, Rohit Sonker, Philipp Becker, Gerhard Neumann

Recurrent State-space models (RSSMs) are highly expressive models for learning patterns in time series data and system identification. However, these models assume that the dynamics are fixed and unchanging, which is rarely the case in real-world scenarios. Many control applications often exhibit tasks with similar but not identical dynamics which can be modeled as a latent variable. We introduce the Hidden Parameter Recurrent State Space Models (HiP-RSSMs), a framework that parametrizes a family of related dynamical systems with a low-dimensional set of latent factors. We present a simple and effective way of learning and performing inference over this Gaussian graphical model that avoids approximations like variational inference. We show that HiP-RSSMs outperforms RSSMs and competing multi-task models on several challenging robotic benchmarks both on real-world systems and simulations.

📄 PDF Abstract BibTeX arXiv:2206.14697

Code (1)

ALRhub/HiP-RSSM 공식 구현 pytorch

Tasks

State Space ModelsTime SeriesTime Series AnalysisVariational Inference

Similar Papers 제목 키워드 기반

Sparsely Changing Latent States for Prediction and Planning in Partially Observable Domains

2021-10-29 · NeurIPS 2021 12 · Christian Gumbsch, Martin V. Butz, Georg Martius

A common approach to prediction and planning in partially observable domains is to use recurrent neural networks (RNNs), which ideally develop and maintain a latent memory about hidden, task-relevant factors. We hypothes…

Inductive Bias

Seq103: A Unified Neuroevolution Framework for Compact Sequence Architecture Discovery

2026-06-03 · Wenxiao Li, Yongjian Liu, Qing Xie arxiv

Neuroevolution is a representative neural architecture search paradigm that evolves both network topology and weights through evolutionary algorithms. In this paper, we propose Seq103, a unified NEAT-style neuroevolution…

Neural Architecture SearchText Classification

LongSSM: On the Length Extension of State-space Models in Language Modelling

2024-06-04 · Shida Wang

In this paper, we investigate the length-extension of state-space models (SSMs) in language modeling. Length extension involves training models on short sequences and testing them on longer ones. We show that state-space…

Language ModelingLanguage ModellingState Space Models

Learning and Understanding a Disentangled Feature Representation for Hidden Parameters in Reinforcement Learning

2022-11-29 · Christopher Reale, Rebecca Russell

Hidden parameters are latent variables in reinforcement learning (RL) environments that are constant over the course of a trajectory. Understanding what, if any, hidden parameters affect a particular environment can aid …

Metric Learningreinforcement-learningReinforcement Learning (RL)

Contextual Recurrent Neural Networks

2019-02-09 · Sam Wenke, Jim Fleming

There is an implicit assumption that by unfolding recurrent neural networks (RNN) in finite time, the misspecification of choosing a zero value for the initial hidden state is mitigated by later time steps. This assumpti…

Retrieval