Revisiting Stereo Depth Estimation From a Sequence-to-Sequence Perspective with Transformers
Stereo depth estimation relies on optimal correspondence matching between pixels on epipolar lines in the left and right images to infer depth. In this work, we revisit the problem from a sequence-to-sequence correspondence perspective to replace cost volume construction with dense pixel matching using position information and attention. This approach, named STereo TRansformer (STTR), has several advantages: It 1) relaxes the limitation of a fixed disparity range, 2) identifies occluded regions and provides confidence estimates, and 3) imposes uniqueness constraints during the matching process. We report promising results on both synthetic and real-world datasets and demonstrate that STTR generalizes across different domains, even without fine-tuning.
Code (1)
Tasks
Depth EstimationPositionStereo Depth EstimationSimilar Papers 제목 키워드 기반
MEStereo-Du2CNN: A Novel Dual Channel CNN for Learning Robust Depth Estimates from Multi-exposure Stereo Images for HDR 3D Applications
Display technologies have evolved over the years. It is critical to develop practical HDR capturing, processing, and display solutions to bring 3D technologies to the next level. Depth estimation of multi-exposure stereo…
Depth EstimationStereo Depth EstimationStereo MatchingTransfer LearningHelvipad: A Real-World Dataset for Omnidirectional Stereo Depth Estimation
Despite progress in stereo depth estimation, omnidirectional imaging remains underexplored, mainly due to the lack of appropriate data. We introduce Helvipad, a real-world dataset for omnidirectional stereo depth estimat…
Depth CompletionDepth EstimationOmnnidirectional Stereo Depth EstimationStereo Depth EstimationUnsupervised Learning of Monocular Depth Estimation and Visual Odometry with Deep Feature Reconstruction
Despite learning based methods showing promising results in single view depth estimation and visual odometry, most existing approaches treat the tasks in a supervised manner. Recent approaches to single view depth estima…
Depth And Camera MotionDepth EstimationDepth PredictionMonocular Depth Estimation+1Learning monocular depth estimation infusing traditional stereo knowledge
Depth estimation from a single image represents a fascinating, yet challenging problem with countless applications. Recent works proved that this task could be learned without direct supervision from ground truth labels …
Depth EstimationImage GenerationMonocular Depth EstimationStereo Matching+1Unsupervised Single-shot Depth Estimation using Perceptual Reconstruction
Real-time estimation of actual object depth is an essential module for various autonomous system tasks such as 3D reconstruction, scene understanding and condition assessment. During the last decade of machine learning, …
3D ReconstructionDepth EstimationFace RecognitionScene Understanding