Overcoming Adversarial Attacks for Human-in-the-Loop Applications
Including human analysis has the potential to positively affect the robustness of Deep Neural Networks and is relatively unexplored in the Adversarial Machine Learning literature. Neural network visual explanation maps have been shown to be prone to adversarial attacks. Further research is needed in order to select robust visualizations of explanations for the image analyst to evaluate a given model. These factors greatly impact Human-In-The-Loop (HITL) evaluation tools due to their reliance on adversarial images, including explanation maps and measurements of robustness. We believe models of human visual attention may improve interpretability and robustness of human-machine imagery analysis systems. Our challenge remains, how can HITL evaluation be robust in this adversarial landscape?
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
SecureSense: Defending Adversarial Attack for Secure Device-Free Human Activity Recognition
Deep neural networks have empowered accurate device-free human activity recognition, which has wide applications. Deep models can extract robust features from various sensors and generalize well even in challenging situa…
Activity RecognitionAdversarial AttackHuman Activity RecognitionPerson IdentificationTA3: Testing Against Adversarial Attacks on Machine Learning Models
Adversarial attacks are major threats to the deployment of machine learning (ML) models in many applications. Testing ML models against such attacks is becoming an essential step for evaluating and improving ML models. I…
Human Adversarial QA: Did the Model Understand the Paragraph?
Recently, adversarial attacks have become an important means of gauging the robustness of natural language models as training and testing set methodology has proved inadequate. In this paper we explore an evaluation base…
Language ModelingLanguage ModellingQuestion AnsweringBreak it, Imitate it, Fix it: Robustness by Generating Human-Like Attacks
Real-world natural language processing systems need to be robust to human adversaries. Collecting examples of human adversaries for training is an effective but expensive solution. On the other hand, training on syntheti…
Hate Speech DetectionAttacking the Loop: Adversarial Attacks on Graph-based Loop Closure Detection
With the advancement in robotics, it is becoming increasingly common for large factories and warehouses to incorporate visual SLAM (vSLAM) enabled automated robots that operate closely next to humans. This makes any adve…
Loop Closure Detection