paper-with-me

홈 › Papers

MINERVAS: Massive INterior EnviRonments VirtuAl Synthesis

2021-07-13 · Haocheng Ren, Hao Zhang, Jia Zheng, Jiaxiang Zheng, Rui Tang, Yuchi Huo, Hujun Bao, Rui Wang

With the rapid development of data-driven techniques, data has played an essential role in various computer vision tasks. Many realistic and synthetic datasets have been proposed to address different problems. However, there are lots of unresolved challenges: (1) the creation of dataset is usually a tedious process with manual annotations, (2) most datasets are only designed for a single specific task, (3) the modification or randomization of the 3D scene is difficult, and (4) the release of commercial 3D data may encounter copyright issue. This paper presents MINERVAS, a Massive INterior EnviRonments VirtuAl Synthesis system, to facilitate the 3D scene modification and the 2D image synthesis for various vision tasks. In particular, we design a programmable pipeline with Domain-Specific Language, allowing users to (1) select scenes from the commercial indoor scene database, (2) synthesize scenes for different tasks with customized rules, and (3) render various imagery data, such as visual color, geometric structures, semantic label. Our system eases the difficulty of customizing massive numbers of scenes for different tasks and relieves users from manipulating fine-grained scene configurations by providing user-controllable randomness using multi-level samplers. Most importantly, it empowers users to access commercial scene databases with millions of indoor scenes and protects the copyright of core data assets, e.g., 3D CAD models. We demonstrate the validity and flexibility of our system by using our synthesized data to improve the performance on different kinds of computer vision tasks.

📄 PDF Abstract BibTeX arXiv:2107.06149

Code (0)

등록된 구현이 없습니다.

Tasks

2D Semantic SegmentationDepth EstimationRoom Layout Estimation

Similar Papers 제목 키워드 기반

Learning from THEODORE: A Synthetic Omnidirectional Top-View Indoor Dataset for Deep Transfer Learning

2020-11-11 · Tobias Scheck, Roman Seidel, Gangolf Hirtz

Recent work about synthetic indoor datasets from perspective views has shown significant improvements of object detection results with Convolutional Neural Networks(CNNs). In this paper, we introduce THEODORE: a novel, l…

Image GenerationObjectobject-detectionObject Detection+2

AURORA: Automated Unleash of 3D Room Outlines for VR Applications

2024-12-15 · Huijun Han, Yongqing Liang, Yuanlong Zhou, Wenping Wang 외

Creating realistic VR experiences is challenging due to the labor-intensive process of accurately replicating real-world details into virtual scenes, highlighting the need for automated methods that maintain spatial accu…

3D Reconstruction

Adversarial Model for Rotated Indoor Scenes Planning

2020-06-24 · Xinhan Di, Pengqian Yu, Hong Zhu, Lei Cai 외

In this paper, we propose an adversarial model for producing furniture layout for interior scene synthesis when the interior room is rotated. The proposed model combines a conditional adversarial network, a rotation modu…

Layout Generationmodel

VIDES: Virtual Interior Design via Natural Language and Visual Guidance

2023-08-26 · Minh-Hien Le, Chi-Bien Chu, Khanh-Duy Le, Tam V. Nguyen 외

Interior design is crucial in creating aesthetically pleasing and functional indoor spaces. However, developing and editing interior design concepts requires significant time and expertise. We propose Virtual Interior DE…

End-to-end Generative Floor-plan and Layout with Attributes and Relation Graph

2020-12-15 · Xinhan Di, Pengqian Yu, Danfeng Yang, Hong Zhu 외

In this paper, we propose an end-end model for producing furniture layout for interior scene synthesis from the random vector. This proposed model is aimed to support professional interior designers to produce the interi…

Layout GenerationRelation