paper-with-me

Papers

Constructing a 3D Town from a Single Image

2025-05-21 · Kaizhi Zheng, Ruijian Zhang, Jing Gu, Jie Yang, Xin Eric Wang

Acquiring detailed 3D scenes typically demands costly equipment, multi-view data, or labor-intensive modeling. Therefore, a lightweight alternative, generating complex 3D scenes from a single top-down image, plays an essential role in real-world applications. While recent 3D generative models have achieved remarkable results at the object level, their extension to full-scene generation often leads to inconsistent geometry, layout hallucinations, and low-quality meshes. In this work, we introduce 3DTown, a training-free framework designed to synthesize realistic and coherent 3D scenes from a single top-down view. Our method is grounded in two principles: region-based generation to improve image-to-3D alignment and resolution, and spatial-aware 3D inpainting to ensure global scene coherence and high-quality geometry generation. Specifically, we decompose the input image into overlapping regions and generate each using a pretrained 3D object generator, followed by a masked rectified flow inpainting process that fills in missing geometry while maintaining structural continuity. This modular design allows us to overcome resolution bottlenecks and preserve spatial structure without requiring 3D supervision or fine-tuning. Extensive experiments across diverse scenes show that 3DTown outperforms state-of-the-art baselines, including Trellis, Hunyuan3D-2, and TripoSG, in terms of geometry quality, spatial coherence, and texture fidelity. Our results demonstrate that high-quality 3D town generation is achievable from a single image using a principled, training-free approach.

📄 PDF Abstract BibTeX arXiv:2505.15765

Code (0)

등록된 구현이 없습니다.

Tasks

3D InpaintingImage to 3DScene Generation

Methods 이 논문이 사용한 방법론

Inpainting Train a convolutional neural network to generate the contents of an arbitrary image region conditioned on its surroundings.

Similar Papers 제목 키워드 기반

Developing a Purely Visual Based Obstacle Detection using Inverse Perspective Mapping

2018-09-04 · Julian Nubert, Niklas Funk, Fabio Meier, Fabrice Oehler

Our solution is implemented in and for the frame of Duckietown. The goal of Duckietown is to provide a relatively simple platform to explore, tackle and solve many problems linked to autonomous driving. "Duckietown" is s…

Autonomous DrivingManagement

Dreaming Across Towns: Semantic Rollout and Town-Adversarial Regularization for Zero-Shot Held-Out-Town Fixed-Route Driving in CARLA

2026-04-30 · Feeza Khan Khanzada, Jaerock Kwon arxiv

Driving agents trained in one simulated town often perform poorly in a new town because the road shapes, intersections, and lane layouts can be different. This paper studies how to improve this kind of transfer in the CA…

Scene Understanding

Out-of-Town Recommendation with Travel Intention Modeling

2021-01-29 · Haoran Xin, Xinjiang Lu, Tong Xu, Hao liu 외

Out-of-town recommendation is designed for those users who leave their home-town areas and visit the areas they have never been to before. It is challenging to recommend Point-of-Interests (POIs) for out-of-town users si…

point of interests

Intersection Prediction from Single 360° Image via Deep Detection of Possible Direction of Travel

2022-04-10 · Naoki Sugimoto, Satoshi Ikehata, Kiyoharu Aizawa

Movie-Map, an interactive first-person-view map that engages the user in a simulated walking experience, comprises short 360{\deg} video segments separated by traffic intersections that are seamlessly connected according…

Binary Classification

An Initial Study of Bird's-Eye View Generation for Autonomous Vehicles using Cross-View Transformers

2025-08-17 · Felipe Carlos dos Santos, Eric Aislan Antonelo, Gustavo Claudio Karl Couto arxiv

Bird's-Eye View (BEV) maps provide a structured, top-down abstraction that is crucial for autonomous-driving perception. In this work, we employ Cross-View Transformers (CVT) for learning to map camera images to three BE…

Autonomous Vehicles