Generalizable Model-agnostic Semantic Segmentation via Target-specific Normalization
Semantic segmentation in a supervised learning manner has achieved significant progress in recent years. However, its performance usually drops dramatically due to the data-distribution discrepancy between seen and unseen domains when we directly deploy the trained model to segment the images of unseen (or new coming) domains. To this end, we propose a novel domain generalization framework for the generalizable semantic segmentation task, which enhances the generalization ability of the model from two different views, including the training paradigm and the test strategy. Concretely, we exploit the model-agnostic learning to simulate the domain shift problem, which deals with the domain generalization from the training scheme perspective. Besides, considering the data-distribution discrepancy between seen source and unseen target domains, we develop the target-specific normalization scheme to enhance the generalization ability. Furthermore, when images come one by one in the test stage, we design the image-based memory bank (Image Bank in short) with style-based selection policy to select similar images to obtain more accurate statistics of normalization. Extensive experiments highlight that the proposed method produces state-of-the-art performance for the domain generalization of semantic segmentation on multiple benchmark segmentation datasets, i.e., Cityscapes, Mapillary.
Code (1)
Tasks
Domain GeneralizationSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Rein++: Efficient Generalization and Adaptation for Semantic Segmentation with Vision Foundation Models
Vision Foundation Models(VFMs) have achieved remarkable success in various computer vision tasks. However, their application to semantic segmentation is hindered by two significant challenges: (1) the disparity in data s…
Unsupervised Domain AdaptationSemantic SegmentationDomain GeneralizationFSDR: Frequency Space Domain Randomization for Domain Generalization
Domain generalization aims to learn a generalizable model from a known source domain for various unknown target domains. It has been studied widely by domain randomization that transfers source images to different styles…
Domain AdaptationDomain GeneralizationImage Manipulation Detection by Multi-View Multi-Scale Supervision
The key challenge of image manipulation detection is how to learn generalizable features that are sensitive to manipulations in novel data, whilst specific to prevent false alarms on authentic images. Current research em…
Image ManipulationImage Manipulation DetectionImage Manipulation LocalizationSemantic Segmentation+1Generalizable Data-free Objective for Crafting Universal Adversarial Perturbations
Machine learning models are susceptible to adversarial perturbations: small changes to input that can cause large changes in output. It is also demonstrated that there exist input-agnostic perturbations, called universal…
Adversarial AttackDepth EstimationObject RecognitionSemantic SegmentationAutoGPart: Intermediate Supervision Search for Generalizable 3D Part Segmentation
Training a generalizable 3D part segmentation network is quite challenging but of great importance in real-world applications. To tackle this problem, some works design task-specific solutions by translating human unders…
3D Part SegmentationDomain GeneralizationSegmentation