Multi-Granularity Alignment Domain Adaptation for Object Detection
Domain adaptive object detection is challenging due to distinctive data distribution between source domain and target domain. In this paper, we propose a unified multi-granularity alignment based object detection framework towards domain-invariant feature learning. To this end, we encode the dependencies across different granularity perspectives including pixel-, instance-, and category-levels simultaneously to align two domains. Based on pixel-level feature maps from the backbone network, we first develop the omni-scale gated fusion module to aggregate discriminative representations of instances by scale-aware convolutions, leading to robust multi-scale object detection. Meanwhile, the multi-granularity discriminators are proposed to identify which domain different granularities of samples(i.e., pixels, instances, and categories) come from. Notably, we leverage not only the instance discriminability in different categories but also the category consistency between two domains. Extensive experiments are carried out on multiple domain adaptation scenarios, demonstrating the effectiveness of our framework over state-of-the-art algorithms on top of anchor-free FCOS and anchor-based Faster RCNN detectors with different backbones.
Code (1)
Tasks
Domain AdaptationObjectobject-detectionObject DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Unsupervised Domain Adaptation for Cross-Regional Scenes Person Re-identification
In large-scale surveillance systems, the absence of positive cross-camera pedestrian samples in cross-regional scenes poses a limitation on the performance of person re-identification models. To tackle this challenge, an…
Domain AdaptationDomain Adaptive Person Re-IdentificationPerson Re-IdentificationStyle Transfer+1Minimizing the Pretraining Gap: Domain-aligned Text-Based Person Retrieval
In this work, we focus on text-based person retrieval, which identifies individuals based on textual descriptions. Despite advancements enabled by synthetic data for pretraining, a significant domain gap, due to variatio…
Domain AdaptationPerson RetrievalMulti-Granularity Feature Calibration via VFM for Domain Generalized Semantic Segmentation
Domain Generalized Semantic Segmentation (DGSS) aims to improve the generalization ability of models across unseen domains without access to target data during training. Recent advances in DGSS have increasingly exploite…
parameter-efficient fine-tuningSemantic SegmentationDomain GeneralizationSGM3D: Stereo Guided Monocular 3D Object Detection
Monocular 3D object detection aims to predict the object location, dimension and orientation in 3D space alongside the object category given only a monocular image. It poses a great challenge due to its ill-posed propert…
3D Object DetectionAutonomous DrivingDepth EstimationDomain Adaptation+4Robust Domain Adaptive Object Detection with Unified Multi-Granularity Alignment
Domain adaptive detection aims to improve the generalization of detectors on target domain. To reduce discrepancy in feature distributions between two domains, recent approaches achieve domain adaption through feature al…
Domain Adaptationobject-detectionObject Detection