paper-with-me

홈 › Papers

Rethinking Robustness Assessment: Adversarial Attacks on Learning-based Quadrupedal Locomotion Controllers

2024-05-21 · Fan Shi, Chong Zhang, Takahiro Miki, Joonho Lee, Marco Hutter, Stelian Coros

Legged locomotion has recently achieved remarkable success with the progress of machine learning techniques, especially deep reinforcement learning (RL). Controllers employing neural networks have demonstrated empirical and qualitative robustness against real-world uncertainties, including sensor noise and external perturbations. However, formally investigating the vulnerabilities of these locomotion controllers remains a challenge. This difficulty arises from the requirement to pinpoint vulnerabilities across a long-tailed distribution within a high-dimensional, temporally sequential space. As a first step towards quantitative verification, we propose a computational method that leverages sequential adversarial attacks to identify weaknesses in learned locomotion controllers. Our research demonstrates that, even state-of-the-art robust controllers can fail significantly under well-designed, low-magnitude adversarial sequence. Through experiments in simulation and on the real robot, we validate our approach's effectiveness, and we illustrate how the results it generates can be used to robustify the original policy and offer valuable insights into the safety of these black-box policies. Project page: https://fanshi14.github.io/me/rss24.html

📄 PDF Abstract BibTeX arXiv:2405.12424

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

Rethinking Audio-Visual Adversarial Vulnerability from Temporal and Modality Perspectives

2025-02-17 · Zeliang Zhang, Susan Liang, Daiki Shimada, Chenliang Xu

While audio-visual learning equips models with a richer understanding of the real world by leveraging multiple sensory modalities, this integration also introduces new vulnerabilities to adversarial attacks. In this pape…

Adversarial Robustnessaudio-visual learning

Rethinking Targeted Adversarial Attacks For Neural Machine Translation

2024-07-07 · Junjie Wu, Lemao Liu, Wei Bi, Dit-yan Yeung

Targeted adversarial attacks are widely used to evaluate the robustness of neural machine translation systems. Unfortunately, this paper first identifies a critical issue in the existing settings of NMT targeted adversar…

Adversarial AttackMachine TranslationNMTTranslation

Adversarial Robustness Assessment: Why both $L_0$ and $L_\infty$ Attacks Are Necessary

2019-06-14 · Shashank Kotyan, Danilo Vasconcellos Vargas

There exists a vast number of adversarial attacks and defences for machine learning algorithms of various types which makes assessing the robustness of algorithms a daunting task. To make matters worse, there is an intri…

Adversarial Robustnessimage-classificationImage Classification

A Survey of Neural Network Robustness Assessment in Image Recognition

2024-04-12 · Jie Wang, Jun Ai, Minyan Lu, Haoran Su 외

In recent years, there has been significant attention given to the robustness assessment of neural networks. Robustness plays a critical role in ensuring reliable operation of artificial intelligence (AI) systems in comp…

Adversarial Robustnessimage-classificationImage ClassificationSurvey

Rethinking Uncertainty in Deep Learning: Whether and How it Improves Robustness

2020-11-27 · Yilun Jin, Lixin Fan, Kam Woh Ng, Ce Ju 외

Deep neural networks (DNNs) are known to be prone to adversarial attacks, for which many remedies are proposed. While adversarial training (AT) is regarded as the most robust defense, it suffers from poor performance bot…