RobustNet: Improving Domain Generalization in Urban-Scene Segmentation via Instance Selective Whitening
Enhancing the generalization capability of deep neural networks to unseen domains is crucial for safety-critical applications in the real world such as autonomous driving. To address this issue, this paper proposes a novel instance selective whitening loss to improve the robustness of the segmentation networks for unseen domains. Our approach disentangles the domain-specific style and domain-invariant content encoded in higher-order statistics (i.e., feature covariance) of the feature representations and selectively removes only the style information causing domain shift. As shown in Fig. 1, our method provides reasonable predictions for (a) low-illuminated, (b) rainy, and (c) unseen structures. These types of images are not included in the training dataset, where the baseline shows a significant performance drop, contrary to ours. Being simple yet effective, our approach improves the robustness of various backbone networks without additional computational cost. We conduct extensive experiments in urban-scene segmentation and show the superiority of our approach to existing work. Our code is available at https://github.com/shachoi/RobustNet.
Code (2)
Tasks
All-day Semantic SegmentationAutonomous DrivingDomain GeneralizationRobust Object DetectionScene SegmentationSimilar Papers 제목 키워드 기반
Intra-Source Style Augmentation for Improved Domain Generalization
The generalization with respect to domain shifts, as they frequently appear in applications such as autonomous driving, is one of the remaining big challenges for deep learning models. Therefore, we propose an intra-sour…
Autonomous DrivingDiversityDomain GeneralizationSemantic SegmentationIntra- & Extra-Source Exemplar-Based Style Synthesis for Improved Domain Generalization
The generalization with respect to domain shifts, as they frequently appear in applications such as autonomous driving, is one of the remaining big challenges for deep learning models. Therefore, we propose an exemplar-b…
Autonomous DrivingData AugmentationDomain GeneralizationSemantic Segmentation+1Learning Generalized Segmentation for Foggy-scenes by Bi-directional Wavelet Guidance
Learning scene semantics that can be well generalized to foggy conditions is important for safety-crucial applications such as autonomous driving. Existing methods need both annotated clear images and foggy images to tr…
Autonomous DrivingDomain AdaptationDomain GeneralizationFoggy Scene Segmentation+3OpenUrban3D: Annotation-Free Open-Vocabulary Semantic Segmentation of Large-Scale Urban Point Clouds
Open-vocabulary semantic segmentation enables models to recognize and segment objects from arbitrary natural language descriptions, offering the flexibility to handle novel, fine-grained, or functionally defined categori…
Point Cloud SegmentationSemantic SegmentationScene UnderstandingPoint CloudsOccAny: Generalized Unconstrained Urban 3D Occupancy
Relying on in-domain annotations and precise sensor-rig priors, existing 3D occupancy prediction methods are limited in both scalability and out-of-domain generalization. While recent visual geometry foundation models ex…
Domain Generalization