paper-with-me

Papers

Robustness Evaluation of Offline Reinforcement Learning for Robot Control Against Action Perturbations

2024-12-25 · Shingo Ayabe, Takuto Otomo, Hiroshi Kera, Kazuhiko Kawamoto

Offline reinforcement learning, which learns solely from datasets without environmental interaction, has gained attention. This approach, similar to traditional online deep reinforcement learning, is particularly promising for robot control applications. Nevertheless, its robustness against real-world challenges, such as joint actuator faults in robots, remains a critical concern. This study evaluates the robustness of existing offline reinforcement learning methods using legged robots from OpenAI Gym based on average episodic rewards. For robustness evaluation, we simulate failures by incorporating both random and adversarial perturbations, representing worst-case scenarios, into the joint torque signals. Our experiments show that existing offline reinforcement learning methods exhibit significant vulnerabilities to these action perturbations and are more vulnerable than online reinforcement learning methods, highlighting the need for more robust approaches in this field.

📄 PDF Abstract BibTeX arXiv:2412.18781

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningOpenAI Gymreinforcement-learningReinforcement Learning

Similar Papers 제목 키워드 기반

DiSA-IQL: Offline Reinforcement Learning for Robust Soft Robot Control under Distribution Shifts

2025-09-30 · Linjin He, Xinda Qi, Dong Chen, Zhaojian Li 외 arxiv

Soft snake robots offer remarkable flexibility and adaptability in complex environments, yet their control remains challenging due to highly nonlinear dynamics. Existing model-based and bio-inspired controllers rely on s…

Reinforcement LearningOffline RL

Adversarial Fine-tuning in Offline-to-Online Reinforcement Learning for Robust Robot Control

2025-10-15 · Shingo Ayabe, Hiroshi Kera, Kazuhiko Kawamoto arxiv

Offline reinforcement learning enables sample-efficient policy acquisition without risky online interaction, yet policies trained on static datasets remain brittle under action-space perturbations such as actuator faults…

Reinforcement Learning

Challenges and Opportunities in Offline Reinforcement Learning from Visual Observations

2022-06-09 · Cong Lu, Philip J. Ball, Tim G. J. Rudner, Jack Parker-Holder 외

Offline reinforcement learning has shown great promise in leveraging large pre-collected datasets for policy learning, allowing agents to forgo often-expensive online data collection. However, offline reinforcement learn…

Benchmarkingcontinuous-controlContinuous ControlOffline RL+3

Risk-Averse Offline Reinforcement Learning

2021-02-10 · ICLR 2021 1 · Núria Armengol Urpí, Sebastian Curi, Andreas Krause

Training Reinforcement Learning (RL) agents in high-stakes applications might be too prohibitive due to the risk associated to exploration. Thus, the agent can only use data previously collected by safe policies. While p…

reinforcement-learningReinforcement LearningReinforcement Learning (RL)

Solving Multi-Goal Robotic Tasks with Decision Transformer

2024-10-08 · Paul Gajewski, Dominik Żurek, Marcin Pietroń, Kamil Faber

Artificial intelligence plays a crucial role in robotics, with reinforcement learning (RL) emerging as one of the most promising approaches for robot control. However, several key challenges hinder its broader applicatio…

Multi-Goal Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)