paper-with-me

홈 › Papers

MuraNet: Multi-task Floor Plan Recognition with Relation Attention

2023-09-01 · Lingxiao Huang, Jung-Hsuan Wu, Chiching Wei, Wilson Li

The recognition of information in floor plan data requires the use of detection and segmentation models. However, relying on several single-task models can result in ineffective utilization of relevant information when there are multiple tasks present simultaneously. To address this challenge, we introduce MuraNet, an attention-based multi-task model for segmentation and detection tasks in floor plan data. In MuraNet, we adopt a unified encoder called MURA as the backbone with two separated branches: an enhanced segmentation decoder branch and a decoupled detection head branch based on YOLOX, for segmentation and detection tasks respectively. The architecture of MuraNet is designed to leverage the fact that walls, doors, and windows usually constitute the primary structure of a floor plan's architecture. By jointly training the model on both detection and segmentation tasks, we believe MuraNet can effectively extract and utilize relevant features for both tasks. Our experiments on the CubiCasa5k public dataset show that MuraNet improves convergence speed during training compared to single-task models like U-Net and YOLOv3. Moreover, we observe improvements in the average AP and IoU in detection and segmentation tasks, respectively.Our ablation experiments demonstrate that the attention-based unified backbone of MuraNet achieves better feature extraction in floor plan recognition tasks, and the use of decoupled multi-head branches for different tasks further improves model performance. We believe that our proposed MuraNet model can address the disadvantages of single-task models and improve the accuracy and efficiency of floor plan data recognition.

📄 PDF Abstract BibTeX arXiv:2309.00348

Code (0)

등록된 구현이 없습니다.

Tasks

RelationSegmentation

Methods 이 논문이 사용한 방법론

BNB Customer Service Number +1-833-534-1729 설명 없음
Average Pooling 설명 없음
Global Average Pooling Global Average Pooling is a pooling operation designed to replace fully connected layers in classical CNNs. The idea is to generate one feature map for each corresponding…
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Logistic Regression Logistic Regression, despite its name, is a linear model for classification rather than regression. Logistic regression is also known in the literature as logit regression,…
k-Means Clustering k-Means Clustering is a clustering algorithm that divides a training set into $k$ different clusters of examples that are near each other. It works by initializing $k$…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Batch Normalization 설명 없음

Similar Papers 제목 키워드 기반

Deep Floor Plan Recognition Using a Multi-Task Network with Room-Boundary-Guided Attention

2019-08-29 · ICCV 2019 10 · Zhiliang Zeng, Xianzhi Li, Ying Kin Yu, Chi-Wing Fu

This paper presents a new approach to recognize elements in floor plan layouts. Besides walls and rooms, we aim to recognize diverse floor plan elements, such as doors, windows and different types of rooms, in the floor …

Parsing Line Segments of Floor Plan Images Using Graph Neural Networks

2023-03-07 · Mingxiang Chen, Cihui Pan

In this paper, we present a GNN-based Line Segment Parser (GLSP), which uses a junction heatmap to predict line segments' endpoints, and graph neural networks to extract line segments and their categories. Different from…

Line Segment DetectionSemantic Segmentation

Offset-Guided Attention Network for Room-Level Aware Floor Plan Segmentation

2022-10-22 · Zhangyu Wang, Ningyuan Sun

Recognition of floor plans has been a challenging and popular task. Despite that many recent approaches have been proposed for this task, they typically fail to make the room-level unified prediction. Specifically, multi…

Residential Floor Plan Recognition and Reconstruction

2021-06-19 · CVPR 2021 1 · Xiaolei Lv, Shengchu Zhao, Xinyang Yu, Binqiang Zhao

Recognition and reconstruction of residential floor plan drawings are important and challenging in design, decoration, and architectural remodeling fields. An automatic framework is provided that accurately recognize…

3D ReconstructionSegmentation

The Direction-Aware, Learnable, Additive Kernels and the Adversarial Network for Deep Floor Plan Recognition

2020-01-30 · Yuli Zhang, Yeyang He, Shaowen Zhu, Xinhan Di

This paper presents a new approach for the recognition of elements in floor plan layouts. Besides of elements with common shapes, we aim to recognize elements with irregular shapes such as circular rooms and inclined wal…

SegmentationSemantic Segmentation