The Right (Angled) Perspective: Improving the Understanding of Road Scenes Using Boosted Inverse Perspective Mapping
Many tasks performed by autonomous vehicles such as road marking detection, object tracking, and path planning are simpler in bird's-eye view. Hence, Inverse Perspective Mapping (IPM) is often applied to remove the perspective effect from a vehicle's front-facing camera and to remap its images into a 2D domain, resulting in a top-down view. Unfortunately, however, this leads to unnatural blurring and stretching of objects at further distance, due to the resolution of the camera, limiting applicability. In this paper, we present an adversarial learning approach for generating a significantly improved IPM from a single camera image in real time. The generated bird's-eye-view images contain sharper features (e.g. road markings) and a more homogeneous illumination, while (dynamic) objects are automatically removed from the scene, thus revealing the underlying road layout in an improved fashion. We demonstrate our framework using real-world data from the Oxford RobotCar Dataset and show that scene understanding tasks directly benefit from our boosted IPM approach.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous VehiclesObject TrackingScene UnderstandingSimilar Papers 제목 키워드 기반
PT-ResNet: Perspective Transformation-Based Residual Network for Semantic Road Image Segmentation
Semantic road region segmentation is a high-level task, which paves the way towards road scene understanding. This paper presents a residual network trained for semantic road segmentation. Firstly, we represent the proje…
Image Segmentationroad scene understandingRoad SegmentationScene Understanding+2RSUD20K: A Dataset for Road Scene Understanding In Autonomous Driving
Road scene understanding is crucial in autonomous driving, enabling machines to perceive the visual environment. However, recent object detectors tailored for learning on datasets collected from certain geographical loca…
Autonomous DrivingBenchmarkingObjectroad scene understanding+1Delving into Multi-modal Multi-task Foundation Models for Road Scene Understanding: From Learning Paradigm Perspectives
Foundation models have indeed made a profound impact on various fields, emerging as pivotal components that significantly shape the capabilities of intelligent systems. In the context of intelligent vehicles, leveraging …
Continual LearningMulti-Task Learningroad scene understandingScene UnderstandingCROVIA: Seeing Drone Scenes from Car Perspective via Cross-View Adaptation
Understanding semantic scene segmentation of urban scenes captured from the Unmanned Aerial Vehicles (UAV) perspective plays a vital role in building a perception model for UAV. With the limitations of large-scale densel…
Autonomous DrivingScene SegmentationSegmentationRethinking Rainy 3D Scene Reconstruction via Perspective Transforming and Brightness Tuning
Rain degrades the visual quality of multi-view images, which are essential for 3D scene reconstruction, resulting in inaccurate and incomplete reconstruction results. Existing datasets often overlook two critical charact…