Risk-Sensitive Generative Adversarial Imitation Learning

2018-08-13 · Jonathan Lacotte, Mohammad Ghavamzadeh, Yin-Lam Chow, Marco Pavone

We study risk-sensitive imitation learning where the agent's goal is to perform at least as well as the expert in terms of a risk profile. We first formulate our risk-sensitive imitation learning setting. We consider the generative adversarial approach to imitation learning (GAIL) and derive an optimization problem for our formulation, which we call it risk-sensitive GAIL (RS-GAIL). We then derive two different versions of our RS-GAIL optimization problem that aim at matching the risk profiles of the agent and the expert w.r.t. Jensen-Shannon (JS) divergence and Wasserstein distance, and develop risk-sensitive generative adversarial imitation learning algorithms based on these optimization problems. We evaluate the performance of our algorithms and compare them with GAIL and the risk-averse imitation learning (RAIL) algorithms in two MuJoCo and two OpenAI classical control tasks.

📄 PDF Abstract BibTeX arXiv:1808.04468

Code (0)

등록된 구현이 없습니다.

Tasks

Imitation LearningMuJoCo

RAIL: Risk-Averse Imitation Learning

2017-07-20 · Anirban Santara, Abhishek Naik, Balaraman Ravindran, Dipankar Das 외

Imitation learning algorithms learn viable policies by imitating an expert's behavior when reward signals are not available. Generative Adversarial Imitation Learning (GAIL) is a state-of-the-art algorithm for learning p…

Autonomous Driving continuous-control Continuous Control Imitation Learning

Risk Management with Feature-Enriched Generative Adversarial Networks (FE-GAN)

2024-11-23 · Ling Chen

This paper investigates the application of Feature-Enriched Generative Adversarial Networks (FE-GAN) in financial risk management, with a focus on improving the estimation of Value at Risk (VaR) and Expected Shortfall (E…

Generative Adversarial Network Management

Generative AI and Federated Learning for Intrusion Detection Systems: A Survey

2026-07-01 · Jiefei Liu, Abu Saleh Md Tayeen, Pratyay Kumar, Qixu Gong 외 arxiv

Intrusion Detection Systems (IDSs) are essential for monitoring network traffic and identifying malicious activities in modern cyber-physical, Internet of Things (IoT), enterprise, and distributed network environments. H…

Intrusion Detection Federated Learning Data Augmentation Anomaly Detection

Bayesian Robust Optimization for Imitation Learning

2020-07-24 · NeurIPS 2020 12 · Daniel S. Brown, Scott Niekum, Marek Petrik

One of the main challenges in imitation learning is determining what action an agent should take when outside the state distribution of the demonstrations. Inverse reinforcement learning (IRL) can enable generalization t…

Imitation Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Can Perturbations Help Reduce Investment Risks? Risk-Aware Stock Recommendation via Split Variational Adversarial Training

2023-04-20 · Jiezhu Cheng, Kaizhu Huang, Zibin Zheng

In the stock market, a successful investment requires a good balance between profits and risks. Based on the learning to rank paradigm, stock recommendation has been widely studied in quantitative finance to recommend st…

Learning-To-Rank