Joint Layout Estimation and Global Multi-View Registration for Indoor Reconstruction
In this paper, we propose a novel method to jointly solve scene layout estimation and global registration problems for accurate indoor 3D reconstruction. Given a sequence of range data, we first build a set of scene fragments using KinectFusion and register them through pose graph optimization. Afterwards, we alternate between layout estimation and layout-based global registration processes in iterative fashion to complement each other. We extract the scene layout through hierarchical agglomerative clustering and energy-based multi-model fitting in consideration of noisy measurements. Having the estimated scene layout in one hand, we register all the range data through the global iterative closest point algorithm where the positions of 3D points that belong to the layout such as walls and a ceiling are constrained to be close to the layout. We experimentally verify the proposed method with the publicly available synthetic and real-world datasets in both quantitative and qualitative ways.
Code (0)
등록된 구현이 없습니다.
Tasks
3D ReconstructionClusteringSimilar Papers 제목 키워드 기반
MVLayoutNet:3D layout reconstruction with multi-view panoramas
We present MVLayoutNet, an end-to-end network for holistic 3D reconstruction from multi-view panoramas. Our core contribution is to seamlessly combine learned monocular layout estimation and multi-view stereo (MVS) for a…
3D ReconstructionGPR-Net: Multi-view Layout Estimation via a Geometry-aware Panorama Registration Network
Reconstructing 3D layouts from multiple $360^{\circ}$ panoramas has received increasing attention recently as estimating a complete layout of a large-scale and complex room from a single panorama is very difficult. The s…
GPRPolyLayout: Multi-room Manhattan Layout Estimation
Estimating room layouts from multi-view imagery is a core task for indoor scene understanding. Existing methods are typically limited either by poor generalization to new datasets or restrictive geometric assumptions of …
Room Layout EstimationScene UnderstandingMVRackLay: Monocular Multi-View Layout Estimation for Warehouse Racks and Shelves
In this paper, we propose and showcase, for the first time, monocular multi-view layout estimation for warehouse racks and shelves. Unlike typical layout estimation methods, MVRackLay estimates multi-layered layouts, whe…
JPerceiver: Joint Perception Network for Depth, Pose and Layout Estimation in Driving Scenes
Depth estimation, visual odometry (VO), and bird's-eye-view (BEV) scene layout estimation present three critical tasks for driving scene perception, which is fundamental for motion planning and navigation in autonomous d…
Autonomous DrivingDepth EstimationMotion PlanningMulti-Task Learning+2