What's in my Room? Object Recognition on Indoor Panoramic Images
In the last few years, there has been a growing interest in taking advantage of the 360 panoramic images potential, while managing the new challenges they imply. While several tasks have been improved thanks to the contextual information these images offer, object recognition in indoor scenes still remains a challenging problem that has not been deeply investigated. This paper provides an object recognition system that performs object detection and semantic segmentation tasks by using a deep learning model adapted to match the nature of equirectangular images. From these results, instance segmentation masks are recovered, refined and transformed into 3D bounding boxes that are placed into the 3D model of the room. Quantitative and qualitative results support that our method outperforms the state of the art by a large margin and show a complete understanding of the main objects in indoor scenes.
Code (0)
등록된 구현이 없습니다.
Tasks
Instance SegmentationObjectobject-detectionObject DetectionObject RecognitionSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Pano2Room: Novel View Synthesis from a Single Indoor Panorama
Recent single-view 3D generative methods have made significant advancements by leveraging knowledge distilled from extensive 3D object datasets. However, challenges persist in the synthesis of 3D scenes from a single vie…
Novel View SynthesisPanoMixSwap Panorama Mixing via Structural Swapping for Indoor Scene Understanding
The volume and diversity of training data are critical for modern deep learningbased methods. Compared to the massive amount of labeled perspective images, 360 panoramic images fall short in both volume and diversity. In…
Data AugmentationDiversityScene UnderstandingSemantic SegmentationLayouts from Panoramic Images with Geometry and Deep Learning
In this paper, we propose a novel procedure for 3D layout recovery of indoor scenes from single 360 degrees panoramic images. With such images, all scene is seen at once, allowing to recover closed geometries. Our method…
Deep LearningRoomTex: Texturing Compositional Indoor Scenes via Iterative Inpainting
The advancement of diffusion models has pushed the boundary of text-to-3D object generation. While it is straightforward to composite objects into a scene with reasonable geometry, it is nontrivial to texture such a scen…
Edge DetectionText to 3DEvaluating Panoramic 3D Estimation in Indoor Lighting Analysis
This paper presents the use of panoramic 3D estimation in lighting simulation. Conventional lighting simulation necessitates detailed modeling as input, resulting in significant labor effort and time cost. The 3D layout …