Displets: Resolving Stereo Ambiguities Using Object Knowledge
Stereo techniques have witnessed tremendous progress over the last decades, yet some aspects of the problem still remain challenging today. Striking examples are reflecting and textureless surfaces which cannot easily be recovered using traditional local regularizers. In this paper, we therefore propose to regularize over larger distances using object-category specific disparity proposals (displets) which we sample using inverse graphics techniques based on a sparse disparity estimate and a semantic segmentation of the image. The proposed displets encode the fact that objects of certain categories are not arbitrarily shaped but typically exhibit regular structures. We integrate them as non-local regularizer for the challenging object class 'car' into a superpixel based CRF framework and demonstrate its benefits on the KITTI stereo evaluation. At time of submission, our approach ranks first across all KITTI stereo leaderboards.
Code (0)
등록된 구현이 없습니다.
Tasks
ObjectSemantic SegmentationSimilar Papers 제목 키워드 기반
Is the Elephant Flying? Resolving Ambiguities in Text-to-Image Generative Models
Natural language often contains ambiguities that can lead to misinterpretation and miscommunication. While humans can handle ambiguities effectively by asking clarifying questions and/or relying on contextual cues and co…
Common Sense ReasoningSemantic Stereo for Incidental Satellite Images
The increasingly common use of incidental satellite images for stereo reconstruction versus rigidly tasked binocular or trinocular coincident collection is helping to enable timely global-scale 3D mapping; however, relia…
3D ReconstructionScene SegmentationSegmentationDPS-Net: Deep Polarimetric Stereo Depth Estimation
Stereo depth estimation usually struggles to deal with textureless scenes for both traditional and learning-based methods due to the inherent dependence on image correspondence matching. In this paper, we propose a n…
Depth EstimationStereo Depth EstimationLiDAR Prompted Spatio-Temporal Multi-View Stereo for Autonomous Driving
Accurate metric depth is critical for autonomous driving perception and simulation, yet current approaches struggle to achieve high metric accuracy, multi-view and temporal consistency, and cross-domain generalization. T…
Domain GeneralizationAutonomous DrivingDepth EstimationSpin-UP: Spin Light for Natural Light Uncalibrated Photometric Stereo
Natural Light Uncalibrated Photometric Stereo (NaUPS) relieves the strict environment and light assumptions in classical Uncalibrated Photometric Stereo (UPS) methods. However, due to the intrinsic ill-posedness and high…
Inverse Rendering