paper-with-me

홈 › Papers

Full Surround Monodepth from Multiple Cameras

2021-03-31 · Vitor Guizilini, Igor Vasiljevic, Rares Ambrus, Greg Shakhnarovich, Adrien Gaidon

Self-supervised monocular depth and ego-motion estimation is a promising approach to replace or supplement expensive depth sensors such as LiDAR for robotics applications like autonomous driving. However, most research in this area focuses on a single monocular camera or stereo pairs that cover only a fraction of the scene around the vehicle. In this work, we extend monocular self-supervised depth and ego-motion estimation to large-baseline multi-camera rigs. Using generalized spatio-temporal contexts, pose consistency constraints, and carefully designed photometric loss masking, we learn a single network generating dense, consistent, and scale-aware point clouds that cover the same full surround 360 degree field of view as a typical LiDAR scanner. We also propose a new scale-consistent evaluation metric more suitable to multi-camera settings. Experiments on two challenging benchmarks illustrate the benefits of our approach over strong baselines.

📄 PDF Abstract BibTeX arXiv:2104.00152

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingMotion Estimation

Similar Papers 제목 키워드 기반

Towards Scale-Aware Full Surround Monodepth with Transformers

2024-07-15 · Yuchen Yang, Xinyi Wang, Dong Li, Lu Tian 외

Full surround monodepth (FSM) methods can learn from multiple camera views simultaneously in a self-supervised manner to predict the scale-aware depth, which is more practical for real-world applications in contrast to s…

Depth Estimation

SoilingNet: Soiling Detection on Automotive Surround-View Cameras

2019-05-04 · Michal Uricar, Pavel Krizek, Ganesh Sistu, Senthil Yogamani

Cameras are an essential part of sensor suite in autonomous driving. Surround-view cameras are directly exposed to external environment and are vulnerable to get soiled. Cameras have a much higher degradation in performa…

Autonomous DrivingData AugmentationMulti-Task Learningobject-detection+2

3D Visual Perception for Self-Driving Cars using a Multi-Camera System: Calibration, Mapping, Localization, and Obstacle Detection

2017-08-31 · Christian Häne, Lionel Heng, Gim Hee Lee, Friedrich Fraundorfer 외

Cameras are a crucial exteroceptive sensor for self-driving cars as they are low-cost and small, provide appearance information about the environment, and work in various weather conditions. They can be used for multiple…

Camera CalibrationSelf-Driving CarsVisual LocalizationVisual Navigation

Parameter Blending for Multi-Camera Harmonization for Automotive Surround View Systems

2024-06-16 · Yuzhuo Ren, Yining Deng, David Pajak, Robin Jenkin 외

In a surround view system, the image color and tone captured by multiple cameras can be different due to cameras applying auto white balance (AWB), global tone mapping (GTM) individually for each camera. The color and br…

Tone Mapping

A Simple Baseline for Supervised Surround-view Depth Estimation

2023-03-14 · Xianda Guo, Wenjie Yuan, Yunpeng Zhang, Tian Yang 외

Depth estimation has been widely studied and serves as the fundamental step of 3D perception for intelligent vehicles. Though significant progress has been made in monocular depth estimation in the past decades, these at…

Autonomous DrivingDepth EstimationMonocular Depth Estimation