PSMNet: Position-aware Stereo Merging Network for Room Layout Estimation
In this paper, we propose a new deep learning-based method for estimating room layout given a pair of 360 panoramas. Our system, called Position-aware Stereo Merging Network or PSMNet, is an end-to-end joint layout-pose estimator. PSMNet consists of a Stereo Pano Pose (SP2) transformer and a novel Cross-Perspective Projection (CP2) layer. The stereo-view SP2 transformer is used to implicitly infer correspondences between views, and can handle noisy poses. The pose-aware CP2 layer is designed to render features from the adjacent view to the anchor (reference) view, in order to perform view fusion and estimate the visible layout. Our experiments and analysis validate our method, which significantly outperforms the state-of-the-art layout estimators, especially for large and complex room spaces.
Code (1)
Tasks
Omnnidirectional Stereo Depth EstimationPositionRoom Layout EstimationSimilar Papers 제목 키워드 기반
A Decomposition Model for Stereo Matching
In this paper, we present a decomposition model for stereo matching to solve the problem of excessive growth in computational cost (time and memory cost) as the resolution increases. In order to reduce the huge cost of s…
Disparity EstimationmodelStereo MatchingPyramid Stereo Matching Network
Recent work has shown that depth estimation from a stereo pair of images can be formulated as a supervised learning task to be resolved with convolutional neural networks (CNNs). However, current architectures rely on pa…
Depth EstimationOmnnidirectional Stereo Depth EstimationStereo Depth EstimationStereo-LiDAR Fusion+2Positioning radiata pine branches requiring pruning by drone stereo vision
This paper presents a stereo-vision-based system mounted on a drone for detecting and localising radiata pine branches to support autonomous pruning. The proposed pipeline comprises two stages: branch segmentation and de…
Depth EstimationGPR-Net: Multi-view Layout Estimation via a Geometry-aware Panorama Registration Network
Reconstructing 3D layouts from multiple $360^{\circ}$ panoramas has received increasing attention recently as estimating a complete layout of a large-scale and complex room from a single panorama is very difficult. The s…
GPRObject-Centric Stereo Matching for 3D Object Detection
Safe autonomous driving requires reliable 3D object detection-determining the 6 DoF pose and dimensions of objects of interest. Using stereo cameras to solve this task is a cost-effective alternative to the widely used L…
3D Object Detection3D Object Detection From Stereo ImagesAutonomous DrivingDisparity Estimation+5