paper-with-me

홈 › Papers

Automating 3D Dataset Generation with Neural Radiance Fields

2025-03-20 · P. Schulz, T. Hempel, A. Al-Hamadi

3D detection is a critical task to understand spatial characteristics of the environment and is used in a variety of applications including robotics, augmented reality, and image retrieval. Training performant detection models require diverse, precisely annotated, and large scale datasets that involve complex and expensive creation processes. Hence, there are only few public 3D datasets that are additionally limited in their range of classes. In this work, we propose a pipeline for automatic generation of 3D datasets for arbitrary objects. By utilizing the universal 3D representation and rendering capabilities of Radiance Fields, our pipeline generates high quality 3D models for arbitrary objects. These 3D models serve as input for a synthetic dataset generator. Our pipeline is fast, easy to use and has a high degree of automation. Our experiments demonstrate, that 3D pose estimation networks, trained with our generated datasets, archive strong performance in typical application scenarios.

📄 PDF Abstract BibTeX arXiv:2503.15997

Code (1)

PaulSK98/Nerf2Dataset 공식 구현

Tasks

3D Pose EstimationDataset GenerationImage RetrievalPose Estimation

Similar Papers 제목 키워드 기반

Mesh2NeRF: Direct Mesh Supervision for Neural Radiance Field Representation and Generation

2024-03-28 · Yujin Chen, Yinyu Nie, Benjamin Ummenhofer, Reiner Birkl 외

We present Mesh2NeRF, an approach to derive ground-truth radiance fields from textured meshes for 3D generation tasks. Many 3D generative approaches represent 3D scenes as radiance fields for training. Their ground-truth…

3D GenerationNeRF

Slot-guided Volumetric Object Radiance Fields

2024-01-04 · NeurIPS 2023 11 · Di Qi, Tong Yang, Xiangyu Zhang

We present a novel framework for 3D object-centric representation learning. Our approach effectively decomposes complex scenes into individual objects from a single image in an unsupervised fashion. This method, called s…

ObjectRepresentation Learning

HumanGen: Generating Human Radiance Fields with Explicit Priors

2022-12-10 · CVPR 2023 1 · Suyi Jiang, Haoran Jiang, Ziyu Wang, Haimin Luo 외

Recent years have witnessed the tremendous progress of 3D GANs for generating view-consistent radiance fields with photo-realism. Yet, high-quality generation of human radiance fields remains challenging, partially due t…

DiffRF: Rendering-Guided 3D Radiance Field Diffusion

2022-12-02 · CVPR 2023 1 · Norman Müller, Yawar Siddiqui, Lorenzo Porzi, Samuel Rota Bulò 외

We introduce DiffRF, a novel approach for 3D radiance field synthesis based on denoising diffusion probabilistic models. While existing diffusion-based methods operate on images, latent codes, or point cloud data, we are…

Denoising

Neural Radiance Fields for the Real World: A Survey

2025-01-22 · Wenhui Xiao, Remi Chierchia, Rodrigo Santa Cruz, Xuesong Li 외

Neural Radiance Fields (NeRFs) have remodeled 3D scene representation since release. NeRFs can effectively reconstruct complex 3D scenes from 2D images, advancing different fields and applications such as scene understan…

Scene UnderstandingSurvey