FREDOM: Fairness Domain Adaptation Approach to Semantic Scene Understanding
Although Domain Adaptation in Semantic Scene Segmentation has shown impressive improvement in recent years, the fairness concerns in the domain adaptation have yet to be well defined and addressed. In addition, fairness is one of the most critical aspects when deploying the segmentation models into human-related real-world applications, e.g., autonomous driving, as any unfair predictions could influence human safety. In this paper, we propose a novel Fairness Domain Adaptation (FREDOM) approach to semantic scene segmentation. In particular, from the proposed formulated fairness objective, a new adaptation framework will be introduced based on the fair treatment of class distributions. Moreover, to generally model the context of structural dependency, a new conditional structural constraint is introduced to impose the consistency of predicted segmentation. Thanks to the proposed Conditional Structure Network, the self-attention mechanism has sufficiently modeled the structural information of segmentation. Through the ablation studies, the proposed method has shown the performance improvement of the segmentation models and promoted fairness in the model predictions. The experimental results on the two standard benchmarks, i.e., SYNTHIA $\to$ Cityscapes and GTA5 $\to$ Cityscapes, have shown that our method achieved State-of-the-Art (SOTA) performance.
Code (1)
Tasks
Autonomous DrivingDomain AdaptationFairnessScene SegmentationScene UnderstandingSegmentationSimilar Papers 제목 키워드 기반
LiDARNet: A Boundary-Aware Domain Adaptation Model for Point Cloud Semantic Segmentation
We present a boundary-aware domain adaptation model for LiDAR scan full-scene semantic segmentation (LiDARNet). Our model can extract both the domain private features and the domain shared features with a two-branch stru…
DiversityDomain AdaptationSegmentationSemantic SegmentationSceneAdapt: Scene-based domain adaptation for semantic segmentation using adversarial learning
Semantic segmentation methods have achieved outstanding performance thanks to deep learning. Nevertheless, when such algorithms are deployed to new contexts not seen during training, it is necessary to collect and label …
Domain AdaptationSegmentationSemantic SegmentationFogAdapt: Self-Supervised Domain Adaptation for Semantic Segmentation of Foggy Images
This paper presents FogAdapt, a novel approach for domain adaptation of semantic segmentation for dense foggy scenes. Although significant research has been directed to reduce the domain shift in semantic segmentation, a…
Domain AdaptationFoggy Scene SegmentationOpen-Ended Question AnsweringSegmentation+1DRIV100: In-The-Wild Multi-Domain Dataset and Evaluation for Real-World Domain Adaptation of Semantic Segmentation
Together with the recent advances in semantic segmentation, many domain adaptation methods have been proposed to overcome the domain gap between training and deployment environments. However, most previous studies use li…
BenchmarkingDomain AdaptationSemantic SegmentationMulti-Modal Domain Adaptation Across Video Scenes for Temporal Video Grounding
Temporal Video Grounding (TVG) aims to localize the temporal boundary of a specific segment in an untrimmed video based on a given language query. Since datasets in this domain are often gathered from limited video scene…
Domain AdaptationUnsupervised Domain AdaptationVideo Grounding