Improving Object Detection via Local-global Contrastive Learning
Visual domain gaps often impact object detection performance. Image-to-image translation can mitigate this effect, where contrastive approaches enable learning of the image-to-image mapping under unsupervised regimes. However, existing methods often fail to handle content-rich scenes with multiple object instances, which manifests in unsatisfactory detection performance. Sensitivity to such instance-level content is typically only gained through object annotations, which can be expensive to obtain. Towards addressing this issue, we present a novel image-to-image translation method that specifically targets cross-domain object detection. We formulate our approach as a contrastive learning framework with an inductive prior that optimises the appearance of object instances through spatial attention masks, implicitly delineating the scene into foreground regions associated with the target object instances and background non-object regions. Instead of relying on object annotations to explicitly account for object instances during translation, our approach learns to represent objects by contrasting local-global information. This affords investigation of an under-explored challenge: obtaining performant detection, under domain shifts, without relying on object annotations nor detector model fine-tuning. We experiment with multiple cross-domain object detection settings across three challenging benchmarks and report state-of-the-art performance. Project page: https://local-global-detection.github.io
Code (0)
등록된 구현이 없습니다.
Tasks
Contrastive LearningImage-to-Image TranslationObjectobject-detectionObject DetectionTranslationUnsupervised Domain AdaptationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
DetCo: Unsupervised Contrastive Learning for Object Detection
Unsupervised contrastive learning achieves great success in learning image representations with CNN. Unlike most recent methods that focused on improving accuracy of image classification, we present a novel contrastive l…
Contrastive Learningimage-classificationImage ClassificationObject+1Contrastive Learning of Global-Local Video Representations
Contrastive learning has delivered impressive results for various tasks in the self-supervised regime. However, existing approaches optimize for learning representations specific to downstream scenarios, i.e., \textit{gl…
ClassificationContrastive LearningDeepFake DetectionFace Swapping+4Contrastive Learning of Global and Local Video Representations
Contrastive learning has delivered impressive results for various tasks in the self-supervised regime. However, existing approaches optimize for learning representations specific to downstream scenarios, i.e., global rep…
ClassificationContrastive LearningDeepFake DetectionFace Swapping+2Self-supervised Learning with Local Contrastive Loss for Detection and Semantic Segmentation
We present a self-supervised learning (SSL) method suitable for semi-global tasks such as object detection and semantic segmentation. We enforce local consistency between self-learned features, representing corresponding…
Objectobject-detectionObject DetectionSegmentation+2The Role of Local Alignment and Uniformity in Image-Text Contrastive Learning on Medical Images
Image-text contrastive learning has proven effective for pretraining medical image models. When targeting localized downstream tasks like semantic segmentation or object detection, additional local contrastive losses tha…
Contrastive Learningobject-detectionObject DetectionSemantic Segmentation