Adaptive World Models: Learning Behaviors by Latent Imagination Under Non-Stationarity
Developing foundational world models is a key research direction for embodied intelligence, with the ability to adapt to non-stationary environments being a crucial criterion. In this work, we introduce a new formalism, Hidden Parameter-POMDP, designed for control with adaptive world models. We demonstrate that this approach enables learning robust behaviors across a variety of non-stationary RL benchmarks. Additionally, this formalism effectively learns task abstractions in an unsupervised manner, resulting in structured, task-aware latent spaces.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Dream to Control: Learning Behaviors by Latent Imagination
Learned world models summarize an agent's experience to facilitate learning complex behaviors. While learning world models from high-dimensional sensory inputs is becoming feasible through deep learning, there are many p…
Continuous Controlreinforcement-learningReinforcement LearningReinforcement Learning (RL)RISE: Adaptive Imagination for World Action Models
World Action Models (WAMs) improve planning by incorporating future world evolution into action generation, yet existing methods allocate a fixed imagination budget to every scene. We propose RISE (Refining Imagination t…
Latent Imagination Facilitates Zero-Shot Transfer in Autonomous Racing
World models learn behaviors in a latent imagination space to enhance the sample-efficiency of deep reinforcement learning (RL) algorithms. While learning world models for high-dimensional observations (e.g., pixel input…
Autonomous Racingcontinuous-controlContinuous ControlDeep Reinforcement Learning+1Deep Latent Competition: Learning to Race Using Visual Control Policies in Latent Space
Learning competitive behaviors in multi-agent settings such as racing requires long-term reasoning about potential adversarial interactions. This paper presents Deep Latent Competition (DLC), a novel reinforcement learni…
Reinforcement Learning (RL)Choreographer: Learning and Adapting Skills in Imagination
Unsupervised skill learning aims to learn a rich repertoire of behaviors without external supervision, providing artificial agents with the ability to control and influence the environment. However, without appropriate k…
Unsupervised Reinforcement Learning