Stereo Object Matching Network
This paper presents a stereo object matching method that exploits both 2D contextual information from images as well as 3D object-level information. Unlike existing stereo matching methods that exclusively focus on the pixel-level correspondence between stereo images within a volumetric space (i.e., cost volume), we exploit this volumetric structure in a different manner. The cost volume explicitly encompasses 3D information along its disparity axis, therefore it is a privileged structure that can encapsulate the 3D contextual information from objects. However, it is not straightforward since the disparity values map the 3D metric space in a non-linear fashion. Thus, we present two novel strategies to handle 3D objectness in the cost volume space: selective sampling (RoISelect) and 2D-3D fusion (fusion-by-occupancy), which allow us to seamlessly incorporate 3D object-level information and achieve accurate depth performance near the object boundary regions. Our depth estimation achieves competitive performance in the KITTI dataset and the Virtual-KITTI 2.0 dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Object DetectionDepth EstimationObjectStereo MatchingSimilar Papers 제목 키워드 기반
Object-Centric Stereo Matching for 3D Object Detection
Safe autonomous driving requires reliable 3D object detection-determining the 6 DoF pose and dimensions of objects of interest. Using stereo cameras to solve this task is a cost-effective alternative to the widely used L…
3D Object Detection3D Object Detection From Stereo ImagesAutonomous DrivingDisparity Estimation+5Object-Centric Stereo Ranging for Autonomous Driving: From Dense Disparity to Census-Based Template Matching
Accurate depth estimation is critical for autonomous driving perception systems, particularly for long range vehicle detection on highways. Traditional dense stereo matching methods such as Block Matching (BM) and Semi G…
Autonomous DrivingDepth EstimationStereo Frustums: A Siamese Pipeline for 3D Object Detection
The paper proposes a light-weighted stereo frustums matching module for 3D objection detection. The proposed framework takes advantage of a high-performance 2D detector and a point cloud segmentation network to regress 3…
3D Object DetectionAutonomous Drivingobject-detectionObject Detection+4STEREOFLOW: Progressive Stereo Matching with StereoDiT and Transition Flow Matching
Stereo matching is a fundamental task in 3D reconstruction. Despite remarkable advances, the prevailing paradigms formulate stereo matching as a deterministic regression problem, collapsing the multimodal distribution mo…
Zero-shot Generalization3D ReconstructionDeep Laparoscopic Stereo Matching with Transformers
The self-attention mechanism, successfully employed with the transformer structure is shown promise in many computer vision tasks including image recognition, and object detection. Despite the surge, the use of the trans…
object-detectionObject DetectionRepresentation LearningStereo Matching