paper-with-me

홈 › Papers

From None to All: Self-Supervised 3D Reconstruction via Novel View Synthesis

2026-03-29 · Ranran Huang, Weixun Luo, Ye Mao, Krystian Mikolajczyk arxiv

In this paper, we introduce NAS3R, a self-supervised feed-forward framework that jointly learns explicit 3D geometry and camera parameters with no ground-truth annotations and no pretrained priors. During training, NAS3R reconstructs 3D Gaussians from uncalibrated and unposed context views and renders target views using its self-predicted camera parameters, enabling self-supervised training from 2D photometric supervision. To ensure stable convergence, NAS3R integrates reconstruction and camera prediction within a shared transformer backbone regulated by masked attention, and adopts a depth-based Gaussian formulation that facilitates well-conditioned optimization. The framework is compatible with state-of-the-art supervised 3D reconstruction architectures and can incorporate pretrained priors or intrinsic information when available. Extensive experiments show that NAS3R achieves superior results to other self-supervised methods, establishing a scalable and geometry-aware paradigm for 3D reconstruction from unconstrained data. Code and models are publicly available at https://ranrhuang.github.io/nas3r/.

📄 PDF Abstract BibTeX arXiv:2603.27455

Code (0)

등록된 구현이 없습니다.

Tasks

Novel View Synthesis3D Reconstruction

Similar Papers 제목 키워드 기반

ViewNeRF: Unsupervised Viewpoint Estimation Using Category-Level Neural Radiance Fields

2022-12-01 · Octave Mariotti, Oisin Mac Aodha, Hakan Bilen

We introduce ViewNeRF, a Neural Radiance Field-based viewpoint estimation method that learns to predict category-level viewpoints directly from images during training. While NeRF is usually trained with ground-truth came…

NeRFViewpoint Estimation

Robust 3D Gaussian Splatting for Novel View Synthesis in Presence of Distractors

2024-08-21 · Paul Ungermann, Armin Ettenhofer, Matthias Nießner, Barbara Roessle

3D Gaussian Splatting has shown impressive novel view synthesis results; nonetheless, it is vulnerable to dynamic objects polluting the input data of an otherwise static scene, so called distractors. Distractors have sev…

Novel View Synthesis

MonoNeRF: Learning Generalizable NeRFs from Monocular Videos without Camera Pose

2022-10-13 · Yang Fu, Ishan Misra, Xiaolong Wang

We propose a generalizable neural radiance fields - MonoNeRF, that can be trained on large-scale monocular videos of moving in static scenes without any ground-truth annotations of depth and camera poses. MonoNeRF follow…

Camera Pose EstimationDecoderDepth EstimationDisentanglement+3

Spherical View Synthesis for Self-Supervised 360 Depth Estimation

2019-09-17 · Nikolaos Zioulis, Antonis Karakottas, Dimitrios Zarpalas, Federico Alvarez 외

Learning based approaches for depth perception are limited by the availability of clean training data. This has led to the utilization of view synthesis as an indirect objective for learning depth estimation using effici…

3D Depth EstimationDepth Estimation

A self-supervised cyclic neural-analytic approach for novel view synthesis and 3D reconstruction

2025-03-05 · Dragos Costea, Alina Marcu, Marius Leordeanu

Generating novel views from recorded videos is crucial for enabling autonomous UAV navigation. Recent advancements in neural rendering have facilitated the rapid development of methods capable of rendering new trajectori…

3D ReconstructionAutonomous NavigationImage ReconstructionNeural Rendering+1