paper-with-me

홈 › Papers

Tell2Design: A Dataset for Language-Guided Floor Plan Generation

2023-11-27 · Sicong Leng, Yang Zhou, Mohammed Haroon Dupty, Wee Sun Lee, Sam Conrad Joyce, Wei Lu

We consider the task of generating designs directly from natural language descriptions, and consider floor plan generation as the initial research area. Language conditional generative models have recently been very successful in generating high-quality artistic images. However, designs must satisfy different constraints that are not present in generating artistic images, particularly spatial and relational constraints. We make multiple contributions to initiate research on this task. First, we introduce a novel dataset, \textit{Tell2Design} (T2D), which contains more than $80k$ floor plan designs associated with natural language instructions. Second, we propose a Sequence-to-Sequence model that can serve as a strong baseline for future research. Third, we benchmark this task with several text-conditional image generation models. We conclude by conducting human evaluations on the generated samples and providing an analysis of human performance. We hope our contributions will propel the research on language-guided design generation forward.

📄 PDF Abstract BibTeX arXiv:2311.15941

Code (2)

lengsicong/tell2design 공식 구현 jax
lucidrains/imagen-pytorch 공식 구현 pytorch

Tasks

Conditional Image GenerationImage Generation

Similar Papers 제목 키워드 기반

FloorPlan-VLN: A New Paradigm for Floor Plan Guided Vision-Language Navigation

2026-03-18 · Kehan Chen, Yan Huang, Dong An, Jiawei He 외 arxiv

Existing Vision-Language Navigation (VLN) task requires agents to follow verbose instructions, ignoring some potentially useful global spatial priors, limiting their capability to reason about spatial structures. Althoug…

Vision-Language Navigation

Deep Floor Plan Recognition Using a Multi-Task Network with Room-Boundary-Guided Attention

2019-08-29 · ICCV 2019 10 · Zhiliang Zeng, Xianzhi Li, Ying Kin Yu, Chi-Wing Fu

This paper presents a new approach to recognize elements in floor plan layouts. Besides walls and rooms, we aim to recognize diverse floor plan elements, such as doors, windows and different types of rooms, in the floor …

FloVerse: Floor Plan-Guided Multi-Modal Navigation

2026-06-12 · Weiqi Huang, Shuangyi Dong, Jiaxin Li, Yifei Guo 외 arxiv

Floor plans encapsulate compact spatial priors, enabling agents to navigate unseen scenes more efficiently. While prior work has explored floor plan-guided navigation, it has focused mainly on PointNav and a limited set …

ChatHouseDiffusion: Prompt-Guided Generation and Editing of Floor Plans

2024-10-15 · Sizhong Qin, Chengyu He, Qiaoyun Chen, Sen yang 외

The generation and editing of floor plans are critical in architectural planning, requiring a high degree of flexibility and efficiency. Existing methods demand extensive input information and lack the capability for int…

Conditional Image GenerationImage Generation

FloorLevel-Net: Recognizing Floor-Level Lines with Height-Attention-Guided Multi-task Learning

2021-07-06 · Mengyang Wu, Wei Zeng, Chi-Wing Fu

The ability to recognize the position and order of the floor-level lines that divide adjacent building floors can benefit many applications, for example, urban augmented reality (AR). This work tackles the problem of loc…

Data AugmentationMulti-Task Learning