paper-with-me

Papers

InfoGAIL: Interpretable Imitation Learning from Visual Demonstrations

2017-03-26 · NeurIPS 2017 12 · Yunzhu Li, Jiaming Song, Stefano Ermon

The goal of imitation learning is to mimic expert behavior without access to an explicit reward signal. Expert demonstrations provided by humans, however, often show significant variability due to latent factors that are typically not explicitly modeled. In this paper, we propose a new algorithm that can infer the latent structure of expert demonstrations in an unsupervised way. Our method, built on top of Generative Adversarial Imitation Learning, can not only imitate complex behaviors, but also learn interpretable and meaningful representations of complex behavioral data, including visual demonstrations. In the driving domain, we show that a model learned from human demonstrations is able to both accurately reproduce a variety of behaviors and accurately anticipate human actions using raw visual inputs. Compared with various baselines, our method can better capture the latent structure underlying expert demonstrations, often recovering semantically meaningful factors of variation in the data.

📄 PDF Abstract BibTeX arXiv:1703.08840

Code (4)

ermongroup/InfoGAIL 공식 구현 tf
YunzhuLi/InfoGAIL tf
apbose/RLproject_AutonomousNavigation_Torcs tf
sisl/ngsim_env tf

Tasks

Imitation Learning

Similar Papers 제목 키워드 기반

Burn-In Demonstrations for Multi-Modal Imitation Learning

2017-10-13 · Alex Kuefler, Mykel J. Kochenderfer

Recent work on imitation learning has generated policies that reproduce expert behavior from multi-modal data. However, past approaches have focused only on recreating a small number of distinct, expert maneuvers, or hav…

Autonomous DrivingImitation Learning

Ess-InfoGAIL: Semi-supervised Imitation Learning from Imbalanced Demonstrations

2023-09-21 · NeurIPS 2023 11

Imitation learning aims to reproduce expert behaviors without relying on an explicit reward signal. However, real-world demonstrations often present challenges, such as multi-modal, data imbalance, and expensive labeling…

Modeling Human Driving Behavior through Generative Adversarial Imitation Learning

2020-06-10 · Raunak Bhattacharyya, Blake Wulfe, Derek Phillips, Alex Kuefler 외

An open problem in autonomous vehicle safety validation is building reliable models of human driving behavior in simulation. This work presents an approach to learn neural driving policies from real world driving demonst…

Decision MakingDisentanglementImitation LearningSequential Decision Making

Zero-shot Imitation Learning from Demonstrations for Legged Robot Visual Navigation

2019-09-27 · Xinlei Pan, Tingnan Zhang, Brian Ichter, Aleksandra Faust 외

Imitation learning is a popular approach for training visual navigation policies. However, collecting expert demonstrations for legged robots is challenging as these robots can be hard to control, move slowly, and cannot…

DisentanglementImitation LearningVisual Navigation

Extraneousness-Aware Imitation Learning

2022-10-04 · Ray Chen Zheng, Kaizhe Hu, Zhecheng Yuan, Boyuan Chen 외

Visual imitation learning provides an effective framework to learn skills from demonstrations. However, the quality of the provided demonstrations usually significantly affects the ability of an agent to acquire desired …

Imitation Learning