paper-with-me

홈 › Papers

Exploring 3D-aware Latent Spaces for Efficiently Learning Numerous Scenes

2024-03-18 · Antoine Schnepf, Karim Kassab, Jean-Yves Franceschi, Laurent Caraffa, Flavian vasile, Jeremie Mary, Andrew Comport, Valérie Gouet-Brunet

We present a method enabling the scaling of NeRFs to learn a large number of semantically-similar scenes. We combine two techniques to improve the required training time and memory cost per scene. First, we learn a 3D-aware latent space in which we train Tri-Plane scene representations, hence reducing the resolution at which scenes are learned. Moreover, we present a way to share common information across scenes, hence allowing for a reduction of model complexity to learn a particular scene. Our method reduces effective per-scene memory costs by 44% and per-scene time costs by 86% when training 1000 scenes. Our project page can be found at https://3da-ae.github.io .

📄 PDF Abstract BibTeX arXiv:2403.11678

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Latent Space Characterization of Autoencoder Variants

2024-12-06 · Anika Shrivastava, Renu Rameshan, Samar Agnihotri

Understanding the latent spaces learned by deep learning models is crucial in exploring how they represent and generate complex data. Autoencoders (AEs) have played a key role in the area of representation learning, with…

DenoisingRepresentation Learning

Renderers are Good Zero-Shot Representation Learners: Exploring Diffusion Latents for Metric Learning

2023-06-19 · Michael Tang, David Shustin

Can the latent spaces of modern generative neural rendering models serve as representations for 3D-aware discriminative visual understanding tasks? We use retrieval as a proxy for measuring the metric learning properties…

Metric LearningNeural RenderingRetrieval

Exploring Deep Registration Latent Spaces

2021-07-23 · Théo Estienne, Maria Vakalopoulou, Stergios Christodoulidis, Enzo Battistella 외

Explainability of deep neural networks is one of the most challenging and interesting problems in the field. In this study, we investigate the topic focusing on the interpretability of deep learning-based registration me…

Deep LearningHippocampus

Metric Space Magnitude for Evaluating the Diversity of Latent Representations

2023-11-27 · Katharina Limbeck, Rayna Andreeva, Rik Sarkar, Bastian Rieck

The magnitude of a metric space is a novel invariant that provides a measure of the 'effective size' of a space across multiple scales, while also capturing numerous geometrical properties, such as curvature, density, or…

Dimensionality ReductionDiversityRepresentation Learning

All Roads Lead to Rome? Exploring Representational Similarities Between Latent Spaces of Generative Image Models

2024-07-18 · Charumathi Badrinath, Usha Bhalla, Alex Oesterling, Suraj Srinivas 외

Do different generative image models secretly learn similar underlying representations? We investigate this by measuring the latent space similarity of four different models: VAEs, GANs, Normalizing Flows (NFs), and Diff…

AllAttribute