Domain Adaptation of Synthetic Driving Datasets for Real-World Autonomous Driving
While developing perception based deep learning models, the benefit of synthetic data is enormous. However, performance of networks trained with synthetic data for certain computer vision tasks degrade significantly when tested on real world data due to the domain gap between them. One of the popular solutions in bridging this gap between synthetic and actual world data is to frame it as a domain adaptation task. In this paper, we propose and evaluate novel ways for the betterment of such approaches. In particular we build upon the method of UNIT-GAN. In normal GAN training for the task of domain translation, pairing of images from both the domains (viz, real and synthetic) is done randomly. We propose a novel method to efficiently incorporate semantic supervision into this pair selection, which helps in boosting the performance of the model along with improving the visual quality of such transformed images. We illustrate our empirical findings on Cityscapes \cite{cityscapes} and challenging synthetic dataset Synscapes. Though the findings are reported on the base network of UNIT-GAN, they can be easily extended to any other similar network.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingDomain AdaptationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Structured prototype regularization for synthetic-to-real driving scene parsing
Driving scene parsing is critical for autonomous vehicles to operate reliably in complex real-world traffic environments. To reduce the reliance on costly pixel-level annotations, synthetic datasets with automatically ge…
Unsupervised Domain AdaptationAutonomous VehiclesScene ParsingSHIFT: A Synthetic Driving Dataset for Continuous Multi-Task Domain Adaptation
Adapting to a continuously evolving environment is a safety-critical challenge inevitably faced by all autonomous driving systems. Existing image and video driving datasets, however, fall short of capturing the mutable n…
Autonomous DrivingDomain AdaptationGIPSO: Geometrically Informed Propagation for Online Adaptation in 3D LiDAR Segmentation
3D point cloud semantic segmentation is fundamental for autonomous driving. Most approaches in the literature neglect an important aspect, i.e., how to deal with domain shift when handling dynamic scenes. This can signif…
Autonomous DrivingDomain AdaptationOnline unsupervised domain adaptationPoint Cloud Segmentation+3Sim-to-Real Domain Adaptation for Lane Detection and Classification in Autonomous Driving
While supervised detection and classification frameworks in autonomous driving require large labelled datasets to converge, Unsupervised Domain Adaptation (UDA) approaches, facilitated by synthetic data generated from ph…
Autonomous DrivingClassificationDomain AdaptationLane Detection+1Synthetic-to-Real Domain Adaptation for Lane Detection
Accurate lane detection, a crucial enabler for autonomous driving, currently relies on obtaining a large and diverse labeled training dataset. In this work, we explore learning from abundant, randomly generated synthetic…
Autonomous DrivingDomain AdaptationLane DetectionSemi-supervised Domain Adaptation+1