Learning Behavioral Soft Constraints from Demonstrations

2022-02-21 · Arie Glazier, Andrea Loreggia, Nicholas Mattei, Taher Rahgooy, Francesca Rossi, Brent Venable

Many real-life scenarios require humans to make difficult trade-offs: do we always follow all the traffic rules or do we violate the speed limit in an emergency? These scenarios force us to evaluate the trade-off between collective rules and norms with our own personal objectives and desires. To create effective AI-human teams, we must equip AI agents with a model of how humans make these trade-offs in complex environments when there are implicit and explicit rules and constraints. Agent equipped with these models will be able to mirror human behavior and/or to draw human attention to situations where decision making could be improved. To this end, we propose a novel inverse reinforcement learning (IRL) method: Max Entropy Inverse Soft Constraint IRL (MESC-IRL), for learning implicit hard and soft constraints over states, actions, and state features from demonstrations in deterministic and non-deterministic environments modeled as Markov Decision Processes (MDPs). Our method enables agents implicitly learn human constraints and desires without the need for explicit modeling by the agent designer and to transfer these constraints between environments. Our novel method generalizes prior work which only considered deterministic hard constraints and achieves state of the art performance.

📄 PDF Abstract BibTeX arXiv:2202.10407

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Making

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

DRIVE: Dynamic Rule Inference and Verified Evaluation for Constraint-Aware Autonomous Driving

2025-08-06 · Longling Geng, Huangxing Li, Viktor Lado Naess, Mert Pilanci arxiv

Understanding and adhering to soft constraints is essential for safe and socially compliant autonomous driving. However, such constraints are often implicit, context-dependent, and difficult to specify explicitly. In thi…

Autonomous Driving

Learner-aware Teaching: Inverse Reinforcement Learning with Preferences and Constraints

2019-06-02 · NeurIPS 2019 12 · Sebastian Tschiatschek, Ahana Ghosh, Luis Haug, Rati Devidze 외

Inverse reinforcement learning (IRL) enables an agent to learn complex behavior by observing demonstrations from a (near-)optimal policy. The typical assumption is that the learner's goal is to match the teacher's demons…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

What Would pi* Do?: Imitation Learning via Off-Policy Reinforcement Learning

2018-09-27 · Siddharth Reddy, Anca D. Dragan, Sergey Levine

Learning to imitate expert actions given demonstrations containing image observations is a difficult problem in robotic control. The key challenge is generalizing behavior to out-of-distribution states that differ from t…

Imitation Learning Q-Learning reinforcement-learning Reinforcement Learning (RL)

Making Human-Like Trade-offs in Constrained Environments by Learning from Demonstrations

2021-09-22 · Arie Glazier, Andrea Loreggia, Nicholas Mattei, Taher Rahgooy 외

Decision Making

Learning a Behavioral Repertoire from Demonstrations

2019-07-05 · Niels Justesen, Miguel Gonzalez Duque, Daniel Cabarcas Jaramillo, Jean-Baptiste Mouret 외

Imitation Learning (IL) is a machine learning approach to learn a policy from a dataset of demonstrations. IL can be useful to kick-start learning before applying reinforcement learning (RL) but it can also be useful on …

Imitation Learning Reinforcement Learning Reinforcement Learning (RL)Starcraft+1