MCPDepth: Omnidirectional Depth Estimation via Stereo Matching from Multi-Cylindrical Panoramas
We introduce Multi-Cylindrical Panoramic Depth Estimation (MCPDepth), a two-stage framework for omnidirectional depth estimation via stereo matching between multiple cylindrical panoramas. MCPDepth uses cylindrical panoramas for initial stereo matching and then fuses the resulting depth maps across views. A circular attention module is employed to overcome the distortion along the vertical axis. MCPDepth exclusively utilizes standard network components, simplifying deployment to embedded devices and outperforming previous methods that require custom kernels. We theoretically and experimentally compare spherical and cylindrical projections for stereo matching, highlighting the advantages of the cylindrical projection. MCPDepth achieves state-of-the-art performance with an 18.8% reduction in mean absolute error (MAE) for depth on the outdoor synthetic dataset Deep360 and a 19.9% reduction on the indoor real-scene dataset 3D60.
Code (0)
등록된 구현이 없습니다.
Tasks
Depth EstimationStereo MatchingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Boosting Omnidirectional Stereo Matching with a Pre-trained Depth Foundation Model
Omnidirectional depth perception is essential for mobile robotics applications that require scene understanding across a full 360{\deg} field of view. Camera-based setups offer a cost-effective option by using stereo dep…
Depth EstimationMonocular Depth EstimationOmnnidirectional Stereo Depth EstimationScene Understanding+2PanoDepth: A Two-Stage Approach for Monocular Omnidirectional Depth Estimation
Omnidirectional 3D information is essential for a wide range of applications such as Virtual Reality, Autonomous Driving, Robotics, etc. In this paper, we propose a novel, model-agnostic, two-stage pipeline for omnidirec…
Autonomous DrivingDepth EstimationMonocular Depth EstimationStereo Matching+1OmniMVS: End-to-End Learning for Omnidirectional Stereo Matching
In this paper, we propose a novel end-to-end deep neural network model for omnidirectional depth estimation from a wide-baseline multi-view stereo setup. The images captured with ultra wide field-of-view (FOV) cameras on…
DecoderDepth EstimationStereo MatchingStereo Matching HandHelvipad: A Real-World Dataset for Omnidirectional Stereo Depth Estimation
Despite progress in stereo depth estimation, omnidirectional imaging remains underexplored, mainly due to the lack of appropriate data. We introduce Helvipad, a real-world dataset for omnidirectional stereo depth estimat…
Depth CompletionDepth EstimationOmnnidirectional Stereo Depth EstimationStereo Depth EstimationOmniStereo: Real-time Omnidireactional Depth Estimation with Multiview Fisheye Cameras
Fast and reliable omnidirectional 3D sensing is essential to many applications such as autonomous driving, robotics and drone navigation. While many well-recognized methods have been developed to produce high-quality…
Autonomous DrivingDepth EstimationDrone navigationStereo Matching