paper-with-me

Papers

No More Ambiguity in 360° Room Layout via Bi-Layout Estimation

2024-04-15 · Yu-Ju Tsai, Jin-Cheng Jhang, Jingjing Zheng, Wei Wang, Albert Y. C. Chen, Min Sun, Cheng-Hao Kuo, Ming-Hsuan Yang

Inherent ambiguity in layout annotations poses significant challenges to developing accurate 360{\deg} room layout estimation models. To address this issue, we propose a novel Bi-Layout model capable of predicting two distinct layout types. One stops at ambiguous regions, while the other extends to encompass all visible areas. Our model employs two global context embeddings, where each embedding is designed to capture specific contextual information for each layout type. With our novel feature guidance module, the image feature retrieves relevant context from these embeddings, generating layout-aware features for precise bi-layout predictions. A unique property of our Bi-Layout model is its ability to inherently detect ambiguous regions by comparing the two predictions. To circumvent the need for manual correction of ambiguous annotations during testing, we also introduce a new metric for disambiguating ground truth layouts. Our method demonstrates superior performance on benchmark datasets, notably outperforming leading approaches. Specifically, on the MatterportLayout dataset, it improves 3DIoU from 81.70% to 82.57% across the full test set and notably from 54.80% to 59.97% in subsets with significant ambiguity. Project page: https://liagm.github.io/Bi_Layout/

📄 PDF Abstract BibTeX arXiv:2404.09993

Code (1)

LIAGM/Bi_Layout 공식 구현 pytorch

Tasks

Room Layout Estimation

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

No More Ambiguity in 360deg Room Layout via Bi-Layout Estimation

2024-01-01 · CVPR 2024 1 · Yu-Ju Tsai, Jin-Cheng Jhang, Jingjing Zheng, Wei Wang 외

Inherent ambiguity in layout annotations poses significant challenges to developing accurate 360deg room layout estimation models. To address this issue we propose a novel Bi-Layout model capable of predicting two di…

Room Layout Estimation

3D Room Layout Estimation Beyond the Manhattan World Assumption

2020-09-07 · Dongho Choi

Predicting 3D room layout from single image is a challenging task with many applications. In this paper, we propose a new training and post-processing method for 3D room layout estimation, built on a recent state-of-the-…

Room Layout Estimation

Flat2Layout: Flat Representation for Estimating Layout of General Room Types

2019-05-29 · Chi-Wei Hsiao, Cheng Sun, Min Sun, Hwann-Tzong Chen

This paper proposes a new approach, Flat2Layout, for estimating general indoor room layout from a single-view RGB image whereas existing methods can only produce layout topologies captured from the box-shaped room. The p…

iBARLE: imBalance-Aware Room Layout Estimation

2023-08-29 · Taotao Jing, Lichen Wang, Naji Khosravan, Zhiqiang Wan 외

Room layout estimation predicts layouts from a single panorama. It requires datasets with large-scale and diverse room shapes to train the models. However, there are significant imbalances in real-world datasets includin…

AvgDomain GeneralizationRoom Layout Estimation

Structural Deep Metric Learning for Room Layout Estimation

2020-08-01 · ECCV 2020 8 · Wenzhao Zheng, Jiwen Lu, Jie zhou

In this paper, we propose a structural deep metric learning (SDML) method for room layout estimation, which aims to recover the 3D spatial layout of a cluttered indoor scene from a monocular RGB image. Different from exi…

DecoderMetric LearningRoom Layout Estimation