paper-with-me

홈 › Papers

Adversarial Imitation Learning via Random Search

2020-08-21 · MyungJae Shin, Joongheon Kim

Developing agents that can perform challenging complex tasks is the goal of reinforcement learning. The model-free reinforcement learning has been considered as a feasible solution. However, the state of the art research has been to develop increasingly complicated techniques. This increasing complexity makes the reconstruction difficult. Furthermore, the problem of reward dependency is still exists. As a result, research on imitation learning, which learns policy from a demonstration of experts, has begun to attract attention. Imitation learning directly learns policy based on data on the behavior of the experts without the explicit reward signal provided by the environment. However, imitation learning tries to optimize policies based on deep reinforcement learning such as trust region policy optimization. As a result, deep reinforcement learning based imitation learning also poses a crisis of reproducibility. The issue of complex model-free model has received considerable critical attention. A derivative-free optimization based reinforcement learning and the simplification on policies obtain competitive performance on the dynamic complex tasks. The simplified policies and derivative free methods make algorithm be simple. The reconfiguration of research demo becomes easy. In this paper, we propose an imitation learning method that takes advantage of the derivative-free optimization with simple linear policies. The proposed method performs simple random search in the parameter space of policies and shows computational efficiency. Experiments in this paper show that the proposed model, without a direct reward signal from the environment, obtains competitive performance on the MuJoCo locomotion tasks.

📄 PDF Abstract BibTeX arXiv:2008.09450

Code (0)

등록된 구현이 없습니다.

Tasks

Computational EfficiencyDeep Reinforcement LearningImitation LearningMuJoCoreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Random Search Random Search replaces the exhaustive enumeration of all combinations by selecting them randomly. This can be simply applied to the discrete setting described above, but also…

Similar Papers 제목 키워드 기반

Mitigation of Adversarial Policy Imitation via Constrained Randomization of Policy (CRoP)

2021-09-29 · AAAI Workshop AdvML 2022 2 · Nancirose Piazza, Vahid Behzadan

Deep reinforcement learning (DRL) policies are vulnerable to unauthorized replication attacks, where an adversary exploits imitation learning to reproduce target policies from observed behavior. In this paper, we propose…

Deep Reinforcement LearningImitation Learningreinforcement-learningReinforcement Learning (RL)

On the Limitations of Stochastic Pre-processing Defenses

2022-06-19 · Yue Gao, Ilia Shumailov, Kassem Fawaz, Nicolas Papernot

Defending against adversarial examples remains an open problem. A common belief is that randomness at inference increases the cost of finding adversarial inputs. An example of such a defense is to apply a random transfor…

Adversarial Robustness

Parallelized and Randomized Adversarial Imitation Learning for Safety-Critical Self-Driving Vehicles

2021-12-26 · Won Joon Yun, MyungJae Shin, Soyi Jung, Sean Kwon 외

Self-driving cars and autonomous driving research has been receiving considerable attention as major promising prospects in modern artificial intelligence applications. According to the evolution of advanced driver assis…

Autonomous DrivingImitation LearningSelf-Driving Cars

Random Entangled Tokens for Adversarially Robust Vision Transformer

2024-01-01 · CVPR 2024 1 · Huihui Gong, Minjing Dong, Siqi Ma, Seyit Camtepe 외

Vision Transformers (ViTs) have emerged as a compelling alternative to Convolutional Neural Networks (CNNs) in the realm of computer vision showcasing tremendous potential. However recent research has unveiled a susc…

Adversarial Robustness

Coupled Distributional Random Expert Distillation for World Model Online Imitation Learning

2025-05-04 · Shangzhe Li, Zhiao Huang, Hao Su

Imitation Learning (IL) has achieved remarkable success across various domains, including robotics, autonomous driving, and healthcare, by enabling agents to learn complex behaviors from expert demonstrations. However, e…

Autonomous DrivingDensity EstimationImitation Learning