paper-with-me

Papers

GroundUp: Rapid Sketch-Based 3D City Massing

2024-07-17 · Gizem Esra Unlu, Mohamed Sayed, Yulia Gryaditskaya, Gabriel Brostow

We propose GroundUp, the first sketch-based ideation tool for 3D city massing of urban areas. We focus on early-stage urban design, where sketching is a common tool and the design starts from balancing building volumes (masses) and open spaces. With Human-Centered AI in mind, we aim to help architects quickly revise their ideas by easily switching between 2D sketches and 3D models, allowing for smoother iteration and sharing of ideas. Inspired by feedback from architects and existing workflows, our system takes as a first input a user sketch of multiple buildings in a top-down view. The user then draws a perspective sketch of the envisioned site. Our method is designed to exploit the complementarity of information in the two sketches and allows users to quickly preview and adjust the inferred 3D shapes. Our model has two main components. First, we propose a novel sketch-to-depth prediction network for perspective sketches that exploits top-down sketch shapes. Second, we use depth cues derived from the perspective sketch as a condition to our diffusion model, which ultimately completes the geometry in a top-down view. Thus, our final 3D geometry is represented as a heightfield, allowing users to construct the city `from the ground up'.

📄 PDF Abstract BibTeX arXiv:2407.12739

Code (0)

등록된 구현이 없습니다.

Tasks

3D geometryDepth EstimationDepth Prediction

Methods 이 논문이 사용한 방법론

Focus 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Generating Daylight-driven Architectural Design via Diffusion Models

2024-04-20 · Pengzhi Li, Baijuan Li

In recent years, the rapid development of large-scale models has made new possibilities for interdisciplinary fields such as architecture. In this paper, we present a novel daylight-driven AI-aided architectural design m…

Language ModelingLanguage Modelling

LoD Sketch Extraction from Architectural Models Using Generative AI: Dataset Construction for Multi-Level Architectural Design Generation

2026-01-23 · Xusheng Du, Athiwat Kongkaeo, Ye Zhang, Haoran Xie arxiv

For architectural design, representation across multiple Levels of Details (LoD) is essential for achieving a smooth transition from conceptual massing to detailed modeling. However, traditional LoD modeling processes re…

CoMa: Contextual Massing Generation with Vision-Language Models

2026-01-13 · Evgenii Maslov, Valentin Khrulkov, Anastasia Volkova, Anton Gusarov 외 arxiv

The conceptual design phase in architecture and urban planning, particularly building massing, is complex and heavily reliant on designer intuition and manual effort. To address this, we propose an automated framework fo…

Sketch2Prototype: Rapid Conceptual Design Exploration and Prototyping with Generative AI

2024-03-26 · Kristen M. Edwards, Brandon Man, Faez Ahmed

Sketch2Prototype is an AI-based framework that transforms a hand-drawn sketch into a diverse set of 2D images and 3D prototypes through sketch-to-text, text-to-image, and image-to-3D stages. This framework, shown across …

Image to 3D

Deep3DSketch+: Rapid 3D Modeling from Single Free-hand Sketches

2023-09-22 · Tianrun Chen, Chenglong Fu, Ying Zang, Lanyun Zhu 외

The rapid development of AR/VR brings tremendous demands for 3D content. While the widely-used Computer-Aided Design (CAD) method requires a time-consuming and labor-intensive modeling process, sketch-based 3D modeling o…