Full Surround Monodepth from Multiple Cameras
Self-supervised monocular depth and ego-motion estimation is a promising approach to replace or supplement expensive depth sensors such as LiDAR for robotics applications like autonomous driving. However, most research in this area focuses on a single monocular camera or stereo pairs that cover only a fraction of the scene around the vehicle. In this work, we extend monocular self-supervised depth and ego-motion estimation to large-baseline multi-camera rigs. Using generalized spatio-temporal contexts, pose consistency constraints, and carefully designed photometric loss masking, we learn a single network generating dense, consistent, and scale-aware point clouds that cover the same full surround 360 degree field of view as a typical LiDAR scanner. We also propose a new scale-consistent evaluation metric more suitable to multi-camera settings. Experiments on two challenging benchmarks illustrate the benefits of our approach over strong baselines.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingMotion EstimationSimilar Papers 제목 키워드 기반
Towards Scale-Aware Full Surround Monodepth with Transformers
Full surround monodepth (FSM) methods can learn from multiple camera views simultaneously in a self-supervised manner to predict the scale-aware depth, which is more practical for real-world applications in contrast to s…
Depth EstimationSoilingNet: Soiling Detection on Automotive Surround-View Cameras
Cameras are an essential part of sensor suite in autonomous driving. Surround-view cameras are directly exposed to external environment and are vulnerable to get soiled. Cameras have a much higher degradation in performa…
Autonomous DrivingData AugmentationMulti-Task Learningobject-detection+23D Visual Perception for Self-Driving Cars using a Multi-Camera System: Calibration, Mapping, Localization, and Obstacle Detection
Cameras are a crucial exteroceptive sensor for self-driving cars as they are low-cost and small, provide appearance information about the environment, and work in various weather conditions. They can be used for multiple…
Camera CalibrationSelf-Driving CarsVisual LocalizationVisual NavigationParameter Blending for Multi-Camera Harmonization for Automotive Surround View Systems
In a surround view system, the image color and tone captured by multiple cameras can be different due to cameras applying auto white balance (AWB), global tone mapping (GTM) individually for each camera. The color and br…
Tone MappingA Simple Baseline for Supervised Surround-view Depth Estimation
Depth estimation has been widely studied and serves as the fundamental step of 3D perception for intelligent vehicles. Though significant progress has been made in monocular depth estimation in the past decades, these at…
Autonomous DrivingDepth EstimationMonocular Depth Estimation