paper-with-me

홈 › Papers

Spatiotemporal Costmap Inference for MPC via Deep Inverse Reinforcement Learning

2022-01-17 · Keuntaek Lee, David Isele, Evangelos A. Theodorou, Sangjae Bae

It can be difficult to autonomously produce driver behavior so that it appears natural to other traffic participants. Through Inverse Reinforcement Learning (IRL), we can automate this process by learning the underlying reward function from human demonstrations. We propose a new IRL algorithm that learns a goal-conditioned spatiotemporal reward function. The resulting costmap is used by Model Predictive Controllers (MPCs) to perform a task without any hand-designing or hand-tuning of the cost function. We evaluate our proposed Goal-conditioned SpatioTemporal Zeroing Maximum Entropy Deep IRL (GSTZ)-MEDIRL framework together with MPC in the CARLA simulator for autonomous driving, lane keeping, and lane changing tasks in a challenging dense traffic highway scenario. Our proposed methods show higher success rates compared to other baseline methods including behavior cloning, state-of-the-art RL policies, and MPC with a learning-based behavior prediction model.

📄 PDF Abstract BibTeX arXiv:2201.06539

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous Drivingreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Entropy Regularization 설명 없음
PPO Proximal Policy Optimization, or PPO, is a policy gradient method for reinforcement learning. The motivation was to have an algorithm with the data efficiency and reliable…
CARLA CARLA is an open-source simulator for autonomous driving research. CARLA has been developed from the ground up to support development, training, and validation of autonomous urban…

Similar Papers 제목 키워드 기반

Approximate Inverse Reinforcement Learning from Vision-based Imitation Learning

2020-04-17 · Keuntaek Lee, Bogdan Vlahov, Jason Gibson, James M. Rehg 외

In this work, we present a method for obtaining an implicit objective function for vision-based navigation. The proposed methodology relies on Imitation Learning, Model Predictive Control (MPC), and an interpretation tec…

Autonomous DrivingImitation LearningModel Predictive Controlreinforcement-learning+3

Terrain Costmap Generation via Scaled Preference Conditioning

2025-11-14 · Luisa Mao, Garrett Warnell, Peter Stone, Joydeep Biswas arxiv

Successful autonomous robot navigation in off-road domains requires the ability to generate high-quality terrain costmaps that are able to both generalize well over a wide variety of terrains and rapidly adapt relative c…

Representation LearningSemantic SegmentationTest-time AdaptationRobot Navigation

Arbitrarily Conditioned Hierarchical Flows for Spatiotemporal Events

2026-05-02 · Keyan Chen, Qiwei Yuan, Zhitong Xu, Bin Shen 외 arxiv

Events in spatiotemporal systems are ubiquitous, yet modeling their complex distributions remains challenging. Existing point process models often rely on strong structural assumptions and are typically limited to autore…

Reliability-Guided Depth Fusion for Glare-Resilient Navigation Costmaps

2026-04-14 · Shang-En Tsai, Wei-Cheng Sun arxiv

Specular glare on reflective floors and glass surfaces frequently corrupts RGB-D depth measurements, producing holes and spikes that accumulate as persistent phantom obstacles in occupancy-grid costmaps. This paper propo…

Mars Traversability Prediction: A Multi-modal Self-supervised Approach for Costmap Generation

2025-09-14 · Zongwu Xie, Kaijie Yun, Yang Liu, Yiming Ji 외 arxiv

We present a robust multi-modal framework for predicting traversability costmaps for planetary rovers. Our model fuses camera and LiDAR data to produce a bird's-eye-view (BEV) terrain costmap, trained self-supervised usi…

Domain Generalization