paper-with-me

홈 › Papers

Improving Object Detection via Local-global Contrastive Learning

2024-10-07 · Danai Triantafyllidou, Sarah Parisot, Ales Leonardis, Steven McDonagh

Visual domain gaps often impact object detection performance. Image-to-image translation can mitigate this effect, where contrastive approaches enable learning of the image-to-image mapping under unsupervised regimes. However, existing methods often fail to handle content-rich scenes with multiple object instances, which manifests in unsatisfactory detection performance. Sensitivity to such instance-level content is typically only gained through object annotations, which can be expensive to obtain. Towards addressing this issue, we present a novel image-to-image translation method that specifically targets cross-domain object detection. We formulate our approach as a contrastive learning framework with an inductive prior that optimises the appearance of object instances through spatial attention masks, implicitly delineating the scene into foreground regions associated with the target object instances and background non-object regions. Instead of relying on object annotations to explicitly account for object instances during translation, our approach learns to represent objects by contrasting local-global information. This affords investigation of an under-explored challenge: obtaining performant detection, under domain shifts, without relying on object annotations nor detector model fine-tuning. We experiment with multiple cross-domain object detection settings across three challenging benchmarks and report state-of-the-art performance. Project page: https://local-global-detection.github.io

📄 PDF Abstract BibTeX arXiv:2410.05058

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningImage-to-Image TranslationObjectobject-detectionObject DetectionTranslationUnsupervised Domain Adaptation

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

DetCo: Unsupervised Contrastive Learning for Object Detection

2021-02-09 · ICCV 2021 10 · Enze Xie, Jian Ding, Wenhai Wang, Xiaohang Zhan 외

Unsupervised contrastive learning achieves great success in learning image representations with CNN. Unlike most recent methods that focused on improving accuracy of image classification, we present a novel contrastive l…

Contrastive Learningimage-classificationImage ClassificationObject+1

Contrastive Learning of Global-Local Video Representations

2021-04-07 · Shuang Ma, Zhaoyang Zeng, Daniel McDuff, Yale Song

Contrastive learning has delivered impressive results for various tasks in the self-supervised regime. However, existing approaches optimize for learning representations specific to downstream scenarios, i.e., \textit{gl…

ClassificationContrastive LearningDeepFake DetectionFace Swapping+4

Contrastive Learning of Global and Local Video Representations

2021-12-01 · NeurIPS 2021 12 · Shuang Ma, Zhaoyang Zeng, Daniel McDuff, Yale Song

Contrastive learning has delivered impressive results for various tasks in the self-supervised regime. However, existing approaches optimize for learning representations specific to downstream scenarios, i.e., global rep…

ClassificationContrastive LearningDeepFake DetectionFace Swapping+2

Self-supervised Learning with Local Contrastive Loss for Detection and Semantic Segmentation

2022-07-10 · Ashraful Islam, Ben Lundell, Harpreet Sawhney, Sudipta Sinha 외

We present a self-supervised learning (SSL) method suitable for semi-global tasks such as object detection and semantic segmentation. We enforce local consistency between self-learned features, representing corresponding…

Objectobject-detectionObject DetectionSegmentation+2

The Role of Local Alignment and Uniformity in Image-Text Contrastive Learning on Medical Images

2022-11-14 · Philip Müller, Georgios Kaissis, Daniel Rueckert

Image-text contrastive learning has proven effective for pretraining medical image models. When targeting localized downstream tasks like semantic segmentation or object detection, additional local contrastive losses tha…

Contrastive Learningobject-detectionObject DetectionSemantic Segmentation