paper-with-me

홈 › Papers

HyperDynamics: Generating Expert Dynamics Models by Observation

2021-01-01 · ICLR 2021 1 · Zhou Xian, Shamit Lal, Hsiao-Yu Tung, Emmanouil Antonios Platanios, Katerina Fragkiadaki

We propose HyperDynamics, a framework that conditions on an agent’s interactions with the environment and optionally its visual observations, and generates the parameters of neural dynamics models based on inferred properties of the dynamical system. Physical and visual properties of the environment that are not part of the low-dimensional state yet affect its temporal dynamics are inferred from the interaction history and visual observations, and are implicitly captured in the generated parameters. We test HyperDynamics on a set of object pushing and locomotion tasks. It outperforms existing dynamics models in the literature that adapt to environment variations by learning dynamics over high dimensional visual observations, capturing the interactions of the agent in recurrent state representations, or using gradient-based meta-optimization. We also show our method matches the performance of an ensemble of separately trained experts, while also being able to generalize well to unseen environment variations at test time. We attribute its good performance to the multiplicative interactions between the inferred system properties—captured in the generated parameters—and the low-dimensional state representation of the dynamical system.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Attribute

Similar Papers 제목 키워드 기반

HyperDynamics: Meta-Learning Object and Agent Dynamics with Hypernetworks

2021-03-17 · Zhou Xian, Shamit Lal, Hsiao-Yu Tung, Emmanouil Antonios Platanios 외

We propose HyperDynamics, a dynamics meta-learning framework that conditions on an agent's interactions with the environment and optionally its visual observations, and generates the parameters of neural dynamics models …

AttributeMeta-Learning

MoVEInt: Mixture of Variational Experts for Learning Human-Robot Interactions from Demonstrations

2024-07-10 · Vignesh Prasad, Alap Kshirsagar, Dorothea Koert, Ruth Stock-Homburg 외

Shared dynamics models are important for capturing the complexity and variability inherent in Human-Robot Interaction (HRI). Therefore, learning such shared dynamics models can enhance coordination and adaptability to en…

Mixture-of-Experts

Imitation Learning from Observations under Transition Model Disparity

2022-04-25 · ICLR 2022 4 · Tanmay Gangwani, Yuan Zhou, Jian Peng

Learning to perform tasks by leveraging a dataset of expert observations, also known as imitation learning from observations (ILO), is an important paradigm for learning skills without access to the expert reward functio…

Imitation LearningmodelMuJoCo

A Model-Based Approach for Improving Reinforcement Learning Efficiency Leveraging Expert Observations

2024-02-29 · Erhan Can Ozcan, Vittorio Giammarino, James Queeney, Ioannis Ch. Paschalidis

This paper investigates how to incorporate expert observations (without explicit information on expert actions) into a deep reinforcement learning setting to improve sample efficiency. First, we formulate an augmented po…

continuous-controlContinuous ControlDeep Reinforcement Learningreinforcement-learning+1

Ethics of Generating Synthetic MRI Vocal Tract Views from the Face

2024-07-11 · Muhammad Suhaib Shahid, Gleb E. Yakubov, Andrew P. French

Forming oral models capable of understanding the complete dynamics of the oral cavity is vital across research areas such as speech correction, designing foods for the aging population, and dentistry. Magnetic resonance …

Ethics