Semantic Road Layout Understanding by Generative Adversarial Inpainting
Autonomous driving is becoming a reality, yet vehicles still need to rely on complex sensor fusion to understand the scene they act in. The ability to discern static environment and dynamic entities provides a comprehension of the road layout that poses constraints to the reasoning process about moving objects. We pursue this through a GAN-based semantic segmentation inpainting model to remove all dynamic objects from the scene and focus on understanding its static components such as streets, sidewalks and buildings. We evaluate this task on the Cityscapes dataset and on a novel synthetically generated dataset obtained with the CARLA simulator and specifically designed to quantitatively evaluate semantic segmentation inpaintings. We compare our methods with a variety of baselines working both in the RGB and segmentation domains.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingSegmentationSemantic SegmentationSensor FusionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Semantic Hierarchy Emerges in the Deep Generative Representations for Scene Synthesis
Despite the success of Generative Adversarial Networks (GANs) in image synthesis, there lacks enough understanding on what networks have learned inside the deep generative representations and how photo-realistic images a…
Image GenerationSemantic Hierarchy Emerges in Deep Generative Representations for Scene Synthesis
Despite the success of Generative Adversarial Networks (GANs) in image synthesis, there lacks enough understanding on what generative models have learned inside the deep generative representations and how photo-realistic…
Image GenerationLayoutGAN: Generating Graphic Layouts with Wireframe Discriminator
Layouts are important for graphic design and scene generation. We propose a novel generative adversarial network, named as LayoutGAN, that synthesizes graphic layouts by modeling semantic and geometric relations of 2D el…
Generative Adversarial NetworkLayout GenerationScene GenerationInstance Map based Image Synthesis with a Denoising Generative Adversarial Network
Semantic layouts based Image synthesizing, which has benefited from the success of Generative Adversarial Network (GAN), has drawn much attention in these days. How to enhance the synthesis image equality while keeping t…
DenoisingGenerative Adversarial NetworkImage GenerationSelf-Supervised Road Layout Parsing with Graph Auto-Encoding
Aiming for higher-level scene understanding, this work presents a neural network approach that takes a road-layout map in bird's-eye-view as input, and predicts a human-interpretable graph that represents the road's topo…
Image ReconstructionScene Understanding