A Semantic Consistency Feature Alignment Object Detection Model Based on Mixed-Class Distribution Metrics
Unsupervised domain adaptation is critical in various computer vision tasks, such as object detection, instance segmentation, etc. They attempt to reduce domain bias-induced performance degradation while also promoting model application speed. Previous works in domain adaptation object detection attempt to align image-level and instance-level shifts to eventually minimize the domain discrepancy, but they may align single-class features to mixed-class features in image-level domain adaptation because each image in the object detection task may be more than one class and object. In order to achieve single-class with single-class alignment and mixed-class with mixed-class alignment, we treat the mixed-class of the feature as a new class and propose a mixed-classes $H-divergence$ for object detection to achieve homogenous feature alignment and reduce negative transfer. Then, a Semantic Consistency Feature Alignment Model (SCFAM) based on mixed-classes $H-divergence$ was also presented. To improve single-class and mixed-class semantic information and accomplish semantic separation, the SCFAM model proposes Semantic Prediction Models (SPM) and Semantic Bridging Components (SBC). And the weight of the pix domain discriminator loss is then changed based on the SPM result to reduce sample imbalance. Extensive unsupervised domain adaption experiments on widely used datasets illustrate our proposed approach's robust object detection in domain bias settings.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationInstance SegmentationObjectobject-detectionObject DetectionRobust Object DetectionSemantic SegmentationUnsupervised Domain AdaptationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
SGANet: Semantic and Geometric Alignment for Multimodal Multi-view Anomaly Detection
Multi-view anomaly detection aims to identify surface defects on complex objects using observations captured from multiple viewpoints. However, existing unsupervised methods often suffer from feature inconsistency arisin…
Anomaly DetectionLSA: Localized Semantic Alignment for Enhancing Temporal Consistency in Traffic Video Generation
Controllable video generation has emerged as a versatile tool for autonomous driving, enabling realistic synthesis of traffic scenarios. However, existing methods depend on control signals at inference time to guide the …
Autonomous DrivingObject DetectionVideo GenerationLarge Language Model Guided Progressive Feature Alignment for Multimodal UAV Object Detection
Existing multimodal UAV object detection methods often overlook the impact of semantic gaps between modalities, which makes it difficult to achieve accurate semantic and spatial alignments, limiting detection performance…
Language ModelingLanguage ModellingLarge Language ModelObject+2AutoAlign: Pixel-Instance Feature Aggregation for Multi-Modal 3D Object Detection
Object detection through either RGB images or the LiDAR point clouds has been extensively explored in autonomous driving. However, it remains challenging to make these two data sources complementary and beneficial to eac…
3D Object DetectionAutonomous Drivingobject-detectionObject DetectionContext-Guided Semantic Alignment for Feature Fusion Networks
Feature fusion networks are fundamental components in modern object detectors, aggregating multi-scale features to detect objects of varying sizes. However, directly fusing features from different pyramid levels often in…
Computational Efficiency