Exploring 3D-aware Latent Spaces for Efficiently Learning Numerous Scenes
We present a method enabling the scaling of NeRFs to learn a large number of semantically-similar scenes. We combine two techniques to improve the required training time and memory cost per scene. First, we learn a 3D-aware latent space in which we train Tri-Plane scene representations, hence reducing the resolution at which scenes are learned. Moreover, we present a way to share common information across scenes, hence allowing for a reduction of model complexity to learn a particular scene. Our method reduces effective per-scene memory costs by 44% and per-scene time costs by 86% when training 1000 scenes. Our project page can be found at https://3da-ae.github.io .
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Latent Space Characterization of Autoencoder Variants
Understanding the latent spaces learned by deep learning models is crucial in exploring how they represent and generate complex data. Autoencoders (AEs) have played a key role in the area of representation learning, with…
DenoisingRepresentation LearningRenderers are Good Zero-Shot Representation Learners: Exploring Diffusion Latents for Metric Learning
Can the latent spaces of modern generative neural rendering models serve as representations for 3D-aware discriminative visual understanding tasks? We use retrieval as a proxy for measuring the metric learning properties…
Metric LearningNeural RenderingRetrievalExploring Deep Registration Latent Spaces
Explainability of deep neural networks is one of the most challenging and interesting problems in the field. In this study, we investigate the topic focusing on the interpretability of deep learning-based registration me…
Deep LearningHippocampusMetric Space Magnitude for Evaluating the Diversity of Latent Representations
The magnitude of a metric space is a novel invariant that provides a measure of the 'effective size' of a space across multiple scales, while also capturing numerous geometrical properties, such as curvature, density, or…
Dimensionality ReductionDiversityRepresentation LearningAll Roads Lead to Rome? Exploring Representational Similarities Between Latent Spaces of Generative Image Models
Do different generative image models secretly learn similar underlying representations? We investigate this by measuring the latent space similarity of four different models: VAEs, GANs, Normalizing Flows (NFs), and Diff…
AllAttribute