SceneAdapt: Scene-based domain adaptation for semantic segmentation using adversarial learning
Semantic segmentation methods have achieved outstanding performance thanks to deep learning. Nevertheless, when such algorithms are deployed to new contexts not seen during training, it is necessary to collect and label scene-specific data in order to adapt them to the new domain using fine-tuning. This process is required whenever an already installed camera is moved or a new camera is introduced in a camera network due to the different scene layouts induced by the different viewpoints. To limit the amount of additional training data to be collected, it would be ideal to train a semantic segmentation method using labeled data already available and only unlabeled data coming from the new camera. We formalize this problem as a domain adaptation task and introduce a novel dataset of urban scenes with the related semantic labels. As a first approach to address this challenging task, we propose SceneAdapt, a method for scene adaptation of semantic segmentation algorithms based on adversarial learning. Experiments and comparisons with state-of-the-art approaches to domain adaptation highlight that promising performance can be achieved using adversarial learning both when the two scenes have different but points of view, and when they comprise images of completely different scenes. To encourage research on this topic, we made our code available at our web page: https://iplab.dmi.unict.it/ParkSmartSceneAdaptation/.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
SceneAdapt: Scene-aware Adaptation of Human Motion Diffusion
Human motion is inherently diverse and semantically rich, while also shaped by the surrounding scene. However, existing motion generation approaches fail to generate semantically diverse motion while simultaneously respe…
LiDARNet: A Boundary-Aware Domain Adaptation Model for Point Cloud Semantic Segmentation
We present a boundary-aware domain adaptation model for LiDAR scan full-scene semantic segmentation (LiDARNet). Our model can extract both the domain private features and the domain shared features with a two-branch stru…
DiversityDomain AdaptationSegmentationSemantic SegmentationFogAdapt: Self-Supervised Domain Adaptation for Semantic Segmentation of Foggy Images
This paper presents FogAdapt, a novel approach for domain adaptation of semantic segmentation for dense foggy scenes. Although significant research has been directed to reduce the domain shift in semantic segmentation, a…
Domain AdaptationFoggy Scene SegmentationOpen-Ended Question AnsweringSegmentation+1FREDOM: Fairness Domain Adaptation Approach to Semantic Scene Understanding
Although Domain Adaptation in Semantic Scene Segmentation has shown impressive improvement in recent years, the fairness concerns in the domain adaptation have yet to be well defined and addressed. In addition, fairness …
Autonomous DrivingDomain AdaptationFairnessScene Segmentation+2Fake it, Mix it, Segment it: Bridging the Domain Gap Between Lidar Sensors
Segmentation of lidar data is a task that provides rich, point-wise information about the environment of robots or autonomous vehicles. Currently best performing neural networks for lidar segmentation are fine-tuned to s…
Autonomous VehiclesDomain AdaptationSegmentationSemantic Segmentation+2