An Initial Study of Bird's-Eye View Generation for Autonomous Vehicles using Cross-View Transformers
Bird's-Eye View (BEV) maps provide a structured, top-down abstraction that is crucial for autonomous-driving perception. In this work, we employ Cross-View Transformers (CVT) for learning to map camera images to three BEV's channels - road, lane markings, and planned trajectory - using a realistic simulator for urban driving. Our study examines generalization to unseen towns, the effect of different camera layouts, and two loss formulations (focal and L1). Using training data from only a town, a four-camera CVT trained with the L1 loss delivers the most robust test performance, evaluated in a new town. Overall, our results underscore CVT's promise for mapping camera inputs to reasonably accurate BEV maps.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous VehiclesSimilar Papers 제목 키워드 기반
CalibRBEV: Multi-Camera Calibration via ReversedBird's-eye-view Representations for Autonomous Driving.
Camera calibration consists of determining the intrinsic and extrinsic parameters of an imaging system, which forms the fundamentalbasis for various computer vision tasks and applications, e.g., robotics and autonomous d…
Autonomous DrivingCamera CalibrationUnderstanding Bird's-Eye View of Road Semantics using an Onboard Camera
Autonomous navigation requires scene understanding of the action-space to move or anticipate events. For planner agents moving on the ground plane, such as autonomous vehicles, this translates to scene understanding in t…
Autonomous NavigationAutonomous VehiclesScene UnderstandingFusing Bird View LIDAR Point Cloud and Front View Camera Image for Deep Object Detection
We propose a new method for fusing a LIDAR point cloud and camera-captured images in the deep convolutional neural network (CNN). The proposed method constructs a new layer called non-homogeneous pooling layer to transfo…
3D Object DetectionAutonomous DrivingObjectobject-detection+1BirdSLAM: Monocular Multibody SLAM in Bird's-Eye View
In this paper, we present BirdSLAM, a novel simultaneous localization and mapping (SLAM) system for the challenging scenario of autonomous driving platforms equipped with only a monocular camera. BirdSLAM tackles challen…
Autonomous DrivingMonocular ReconstructionObject LocalizationSimultaneous Localization and MappingDur360BEV: A Real-world 360-degree Single Camera Dataset and Benchmark for Bird-Eye View Mapping in Autonomous Driving
We present Dur360BEV, a novel spherical camera autonomous driving dataset equipped with a high-resolution 128-channel 3D LiDAR and a RTK-refined GNSS/INS system, along with a benchmark architecture designed to generate B…
Autonomous DrivingBEV Segmentation