Estimating Generic 3D Room Structures from 2D Annotations
Indoor rooms are among the most common use cases in 3D scene understanding. Current state-of-the-art methods for this task are driven by large annotated datasets. Room layouts are especially important, consisting of structural elements in 3D, such as wall, floor, and ceiling. However, they are difficult to annotate, especially on pure RGB video. We propose a novel method to produce generic 3D room layouts just from 2D segmentation masks, which are easy to annotate for humans. Based on these 2D annotations, we automatically reconstruct 3D plane equations for the structural elements and their spatial extent in the scene, and connect adjacent elements at the appropriate contact edges. We annotate and publicly release 2246 3D room layouts on the RealEstate10k dataset, containing YouTube videos. We demonstrate the high quality of these 3D layouts annotations with extensive experiments.
Code (1)
Tasks
Scene UnderstandingSimilar Papers 제목 키워드 기반
PolyLayout: Multi-room Manhattan Layout Estimation
Estimating room layouts from multi-view imagery is a core task for indoor scene understanding. Existing methods are typically limited either by poor generalization to new datasets or restrictive geometric assumptions of …
Room Layout EstimationScene UnderstandingDoSA : A System to Accelerate Annotations on Business Documents with Human-in-the-Loop
Business documents come in a variety of structures, formats and information needs which makes information extraction a challenging task. Due to these variations, having a document generic model which can work well across…
Document AIKey Information ExtractionZillow Indoor Dataset: Annotated Floor Plans With 360deg Panoramas and 3D Room Layouts
We present Zillow Indoor Dataset (ZInD): A large indoor dataset with 71,474 panoramas from 1,524 real unfurnished homes. ZInD provides annotations of 3D room layouts, 2D and 3D floor plans, panorama location in the f…
Room Layout EstimationFlat2Layout: Flat Representation for Estimating Layout of General Room Types
This paper proposes a new approach, Flat2Layout, for estimating general indoor room layout from a single-view RGB image whereas existing methods can only produce layout topologies captured from the box-shaped room. The p…
Room Impulse Response Estimation through Optimal Mass Transport Barycenters
In this work, we consider the problem of jointly estimating a set of room impulse responses (RIRs) corresponding to closely spaced microphones. The accurate estimation of RIRs is crucial in acoustic applications such as …
Speech Enhancement