Exploiting Multi-Object Relationships for Detecting Adversarial Attacks in Complex Scenes
Vision systems that deploy Deep Neural Networks (DNNs) are known to be vulnerable to adversarial examples. Recent research has shown that checking the intrinsic consistencies in the input data is a promising way to detect adversarial attacks (e.g., by checking the object co-occurrence relationships in complex scenes). However, existing approaches are tied to specific models and do not offer generalizability. Motivated by the observation that language descriptions of natural scene images have already captured the object co-occurrence relationships that can be learned by a language model, we develop a novel approach to perform context consistency checks using such language models. The distinguishing aspect of our approach is that it is independent of the deployed object detector and yet offers very high accuracy in terms of detecting adversarial examples in practical scenes with multiple objects.
Code (0)
등록된 구현이 없습니다.
Tasks
Language ModelingLanguage ModellingObjectSimilar Papers 제목 키워드 기반
Detecting Visual Relationships with Deep Relational Networks
Relationships among objects play a crucial role in image understanding. Despite the great success of deep learning techniques in recognizing individual objects, reasoning about the relationships among objects remains a c…
DiversityGeneral ClassificationRelational Reasoning using Prior Knowledge for Visual Captioning
Exploiting relationships among objects has achieved remarkable progress in interpreting images or videos by natural language. Most existing methods resort to first detecting objects and their relationships, and then gene…
Image Captioningobject-detectionObject DetectionRelational Reasoning+2ADC: Adversarial attacks against object Detection that evade Context consistency checks
Deep Neural Networks (DNNs) have been shown to be vulnerable to adversarial examples, which are slightly perturbed input images which lead DNNs to make wrong predictions. To protect from such examples, various defense st…
Objectobject-detectionObject DetectionDeconstruct Complexity (DeComplex): A Novel Perspective on Tackling Dense Action Detection
Dense action detection involves detecting multiple co-occurring actions in an untrimmed video while action classes are often ambiguous and represent overlapping concepts. To address this challenge task, we introduce a no…
Action DetectionContrastive LearningDetecting Objects with Context-Likelihood Graphs and Graph Refinement
The goal of this paper is to detect objects by exploiting their interrelationships. Contrary to existing methods, which learn objects and relations separately, our key idea is to learn the object-relation distribution jo…
Objectobject-detectionObject DetectionRelation