paper-with-me

Papers

CodeNeRF: Disentangled Neural Radiance Fields for Object Categories

2021-09-03 · ICCV 2021 10 · Wonbong Jang, Lourdes Agapito

CodeNeRF is an implicit 3D neural representation that learns the variation of object shapes and textures across a category and can be trained, from a set of posed images, to synthesize novel views of unseen objects. Unlike the original NeRF, which is scene specific, CodeNeRF learns to disentangle shape and texture by learning separate embeddings. At test time, given a single unposed image of an unseen object, CodeNeRF jointly estimates camera viewpoint, and shape and appearance codes via optimization. Unseen objects can be reconstructed from a single image, and then rendered from new viewpoints or their shape and texture edited by varying the latent codes. We conduct experiments on the SRN benchmark, which show that CodeNeRF generalises well to unseen objects and achieves on-par performance with methods that require known camera pose at test time. Our results on real-world images demonstrate that CodeNeRF can bridge the sim-to-real gap. Project page: \url{https://github.com/wayne1123/code-nerf}

📄 PDF Abstract BibTeX arXiv:2109.01750

Code (1)

wayne1123/code-nerf 공식 구현 pytorch

Tasks

NeRFObject

Methods 이 논문이 사용한 방법론

SRN Stable Rank Normalization (SRN) is a weight-normalization scheme which minimizes the stable rank of a linear operator. It simultaneously controls the Lipschitz constant and…

Similar Papers 제목 키워드 기반

Generative Deformable Radiance Fields for Disentangled Image Synthesis of Topology-Varying Objects

2022-09-09 · Ziyu Wang, Yu Deng, Jiaolong Yang, Jingyi Yu 외

3D-aware generative models have demonstrated their superb performance to generate 3D neural radiance fields (NeRF) from a collection of monocular 2D images even for topology-varying object categories. However, these meth…

DisentanglementImage GenerationNeRFObject

AE-NeRF: Auto-Encoding Neural Radiance Fields for 3D-Aware Object Manipulation

2022-04-28 · Mira Kim, Jaehoon Ko, Kyusun Cho, Junmyeong Choi 외

We propose a novel framework for 3D-aware object manipulation, called Auto-Encoding Neural Radiance Fields (AE-NeRF). Our model, which is formulated in an auto-encoder architecture, extracts disentangled 3D attributes su…

AttributeDisentanglementNeRF

Canonical Fields: Self-Supervised Learning of Pose-Canonicalized Neural Fields

2022-12-05 · CVPR 2023 1 · Rohith Agaram, Shaurya Dewan, Rahul Sajnani, Adrien Poulenard 외

Coordinate-based implicit neural networks, or neural fields, have emerged as useful representations of shape and appearance in 3D computer vision. Despite advances, however, it remains challenging to build neural fields …

NeRFObjectSelf-Supervised Learning

RehearsalNeRF: Decoupling Intrinsic Neural Fields of Dynamic Illuminations for Scene Editing

2026-03-30 · Changyeon Won, Hyunjun Jung, Jungu Cho, Seonmi Park 외 arxiv

Although there has been significant progress in neural radiance fields, an issue on dynamic illumination changes still remains unsolved. Different from relevant works that parameterize time-variant/-invariant components …

Novel View Synthesis

Towards Efficient Neural Scene Graphs by Learning Consistency Fields

2022-10-09 · Yeji Song, Chaerin Kong, Seoyoung Lee, Nojun Kwak 외

Neural Radiance Fields (NeRF) achieves photo-realistic image rendering from novel views, and the Neural Scene Graphs (NSG) \cite{ost2021neural} extends it to dynamic scenes (video) with multiple objects. Nevertheless, co…

NeRF