Harmonizing Transferability and Discriminability for Adapting Object Detectors
Recent advances in adaptive object detection have achieved compelling results in virtue of adversarial feature adaptation to mitigate the distributional shifts along the detection pipeline. Whilst adversarial adaptation significantly enhances the transferability of feature representations, the feature discriminability of object detectors remains less investigated. Moreover, transferability and discriminability may come at a contradiction in adversarial adaptation given the complex combinations of objects and the differentiated scene layouts between domains. In this paper, we propose a Hierarchical Transferability Calibration Network (HTCN) that hierarchically (local-region/image/instance) calibrates the transferability of feature representations for harmonizing transferability and discriminability. The proposed model consists of three components: (1) Importance Weighted Adversarial Training with input Interpolation (IWAT-I), which strengthens the global discriminability by re-weighting the interpolated image-level features; (2) Context-aware Instance-Level Alignment (CILA) module, which enhances the local discriminability by capturing the underlying complementary effect between the instance-level feature and the global context information for the instance-level feature alignment; (3) local feature masks that calibrate the local transferability to provide semantic guidance for the following discriminative pattern alignment. Experimental results show that HTCN significantly outperforms the state-of-the-art methods on benchmark datasets.
Code (1)
Tasks
Objectobject-detectionObject DetectionWeakly Supervised Object DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Towards Discriminative and Transferable One-Stage Few-Shot Object Detectors
Recent object detection models require large amounts of annotated data for training a new classes of objects. Few-shot object detection (FSOD) aims to address this problem by learning novel classes given only a few sampl…
Few-Shot Object Detectionobject-detectionObject DetectionDomain Contrast for Domain Adaptive Object Detection
We present Domain Contrast (DC), a simple yet effective approach inspired by contrastive learning for training domain adaptive detectors. DC is deduced from the error bound minimization perspective of a transferred model…
Contrastive LearningObjectobject-detectionObject DetectionBalancing Transferability and Discriminability for Unsupervised Domain Adaptation.
Unsupervised domain adaptation (UDA) aims to leverage a sufficiently labeled source domain to classify or represent the fully unlabeled target domain with a different distribution. Generally, the existing approaches try …
Domain AdaptationRepresentation LearningUnsupervised Domain AdaptationTransferability vs. Discriminability: Batch Spectral Penalization for Adversarial Domain Adaptation
Adversarial domain adaptation has made remarkable advances in learning transferable representations for knowledge transfer across domains. While adversarial learning strengthens the feature transferability which the comm…
Domain AdaptationTransfer LearningBalancing Discriminability and Transferability for Source-Free Domain Adaptation
Conventional domain adaptation (DA) techniques aim to improve domain transferability by learning domain-invariant representations; while concurrently preserving the task-discriminability knowledge gathered from the label…
Domain AdaptationSemantic SegmentationSource-Free Domain Adaptation