paper-with-me

Papers

DINAR: Diffusion Inpainting of Neural Textures for One-Shot Human Avatars

2023-03-16 · ICCV 2023 1 · David Svitov, Dmitrii Gudkov, Renat Bashirov, Victor Lempitsky

We present DINAR, an approach for creating realistic rigged fullbody avatars from single RGB images. Similarly to previous works, our method uses neural textures combined with the SMPL-X body model to achieve photo-realistic quality of avatars while keeping them easy to animate and fast to infer. To restore the texture, we use a latent diffusion model and show how such model can be trained in the neural texture space. The use of the diffusion model allows us to realistically reconstruct large unseen regions such as the back of a person given the frontal view. The models in our pipeline are trained using 2D images and videos only. In the experiments, our approach achieves state-of-the-art rendering quality and good generalization to new poses and viewpoints. In particular, the approach improves state-of-the-art on the SnapshotPeople public benchmark.

📄 PDF Abstract BibTeX arXiv:2303.09375

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Latent Diffusion Model Diffusion models applied to latent spaces, which are normally built with (Variational) Autoencoders.
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Infusion: internal diffusion for inpainting of dynamic textures and complex motion

2023-11-02 · Nicolas Cherel, Andrés Almansa, Yann Gousseau, Alasdair Newson

Video inpainting is the task of filling a region in a video in a visually convincing manner. It is very challenging due to the high dimensionality of the data and the temporal consistency required for obtaining convincin…

Image InpaintingOptical Flow EstimationVideo Inpainting

Text2Tex: Text-driven Texture Synthesis via Diffusion Models

2023-03-20 · ICCV 2023 1 · Dave Zhenyu Chen, Yawar Siddiqui, Hsin-Ying Lee, Sergey Tulyakov 외

We present Text2Tex, a novel method for generating high-quality textures for 3D meshes from the given text prompts. Our method incorporates inpainting into a pre-trained depth-aware image diffusion model to progressively…

Texture Synthesis

PointDreamer: Zero-shot 3D Textured Mesh Reconstruction from Colored Point Cloud

2024-06-22 · Qiao Yu, Xianzhi Li, Yuan Tang, Xu Han 외

Reconstructing textured meshes from colored point clouds is an important but challenging task. Most existing methods yield blurry-looking textures or rely on 3D training data that are hard to acquire. Regarding this, we …

Image Inpainting

RadioVIL: Anomaly-Aware Diffusion Models for Radio Map Inpainting and Zero-Shot Vehicle Localization

2026-08-17 · Ruixin Zhao, Xiucheng Wang, Qiming Zhang, Nan Cheng 외 arxiv

High-precision radio map construction is essential for emerging 6G Integrated Sensing and Communication (ISAC) applications, including digital twins and intelligent transportation. However, existing deep learning methods…

RI3D: Few-Shot Gaussian Splatting With Repair and Inpainting Diffusion Priors

2025-03-13 · Avinash Paliwal, Xilong Zhou, Wei Ye, Jinhui Xiong 외

In this paper, we propose RI3D, a novel 3DGS-based approach that harnesses the power of diffusion models to reconstruct high-quality novel views given a sparse set of input images. Our key contribution is separating the …

3DGS