paper-with-me

홈 › Papers

3D Pose Transfer with Correspondence Learning and Mesh Refinement

2021-09-30 · NeurIPS 2021 12 · Chaoyue Song, Jiacheng Wei, Ruibo Li, Fayao Liu, Guosheng Lin

3D pose transfer is one of the most challenging 3D generation tasks. It aims to transfer the pose of a source mesh to a target mesh and keep the identity (e.g., body shape) of the target mesh. Some previous works require key point annotations to build reliable correspondence between the source and target meshes, while other methods do not consider any shape correspondence between sources and targets, which leads to limited generation quality. In this work, we propose a correspondence-refinement network to achieve the 3D pose transfer for both human and animal meshes. The correspondence between source and target meshes is first established by solving an optimal transport problem. Then, we warp the source mesh according to the dense correspondence and obtain a coarse warped mesh. The warped mesh will be better refined with our proposed Elastic Instance Normalization, which is a conditional normalization layer and can help to generate high-quality meshes. Extensive experimental results show that the proposed architecture can effectively transfer the poses from source to target meshes and produce better results with satisfied visual performance than state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2109.15025

Code (1)

chaoyuesong/3d-corenet 공식 구현 pytorch

Tasks

3D GenerationPose Transfer

Methods 이 논문이 사용한 방법론

Instance Normalization Instance Normalization (also known as contrast normalization) is a normalization layer where: $$ y_{tijk} = \frac{x_{tijk} - \mu_{ti}}{\sqrt{\sigma_{ti}^2 +…

Similar Papers 제목 키워드 기반

HMC: Hierarchical Mesh Coarsening for Skeleton-free Motion Retargeting

2023-03-20 · Haoyu Wang, Shaoli Huang, Fang Zhao, Chun Yuan 외

We present a simple yet effective method for skeleton-free motion retargeting. Previous methods transfer motion between high-resolution meshes, failing to preserve the inherent local-part motions in the mesh. Addressing …

motion retargeting

A Graph Neural Network Approach for Temporal Mesh Blending and Correspondence

2023-06-23 · Aalok Gangopadhyay, Abhinav Narayan Harish, Prajwal Singh, Shanmuganathan Raman

We have proposed a self-supervised deep learning framework for solving the mesh blending problem in scenarios where the meshes are not in correspondence. To solve this problem, we have developed Red-Blue MPNN, a novel gr…

Graph Neural NetworkTemporal Sequences

Neural Pose Transfer by Spatially Adaptive Instance Normalization

2020-03-16 · CVPR 2020 6 · Jiashun Wang, Chao Wen, Yanwei Fu, Haitao Lin 외

Pose transfer has been studied for decades, in which the pose of a source mesh is applied to a target mesh. Particularly in this paper, we are interested in transferring the pose of source human mesh to deform the target…

Pose TransferStyle Transfer

3D Human Mesh Regression with Dense Correspondence

2020-06-10 · CVPR 2020 6 · Wang Zeng, Wanli Ouyang, Ping Luo, Wentao Liu 외

Estimating 3D mesh of the human body from a single 2D image is an important task with many applications such as augmented reality and Human-Robot interaction. However, prior works reconstructed 3D mesh from global image …

3D Human Pose Estimation3D Human Reconstructionregression

SGSoft: Learning Fused Semantic-Geometric Features for 3D Shape Correspondence via Template-Guided Soft Signals

2026-05-18 · Soyeon Yoon, Chang Wook Seo, Hyunjung Shim arxiv

Learning dense correspondences across deformable 3D shapes remains a long-standing challenge due to structural variability, non-isometric deformation, and inconsistent topology. Existing methods typically trade off gener…

Semantic Segmentation