paper-with-me

Papers

Human Pose Transfer by Adaptive Hierarchical Deformation

2020-12-13 · Jinsong Zhang, Xingzi Liu, Kun Li

Human pose transfer, as a misaligned image generation task, is very challenging. Existing methods cannot effectively utilize the input information, which often fail to preserve the style and shape of hair and clothes. In this paper, we propose an adaptive human pose transfer network with two hierarchical deformation levels. The first level generates human semantic parsing aligned with the target pose, and the second level generates the final textured person image in the target pose with the semantic guidance. To avoid the drawback of vanilla convolution that treats all the pixels as valid information, we use gated convolution in both two levels to dynamically select the important features and adaptively deform the image layer by layer. Our model has very few parameters and is fast to converge. Experimental results demonstrate that our model achieves better performance with more consistent hair, face and clothes with fewer parameters than state-of-the-art methods. Furthermore, our method can be applied to clothing texture transfer.

📄 PDF Abstract BibTeX arXiv:2012.06940

Code (1)

Zhangjinso/PINet_PG 공식 구현 pytorch

Tasks

Image GenerationPose TransferSemantic Parsingvalid

Methods 이 논문이 사용한 방법론

1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
Gated Linear Unit A Gated Linear Unit, or GLU computes: $$ \mathrm{GLU}(a, b) = a \otimes \sigma(b) $$ It is used in natural language processing architectures, for example the Gated CNN,…
Gated Convolution 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Super-High-Fidelity Image Compression via Hierarchical-ROI and Adaptive Quantization

2024-03-19 · Jixiang Luo, Yan Wang, Hongwei Qin

Learned Image Compression (LIC) has achieved dramatic progress regarding objective and subjective metrics. MSE-based models aim to improve objective metrics while generative models are leveraged to improve visual quality…

Image CompressionQuantization

Scale Selection of Adaptive Kernel Regression by Joint Saliency Map for Nonrigid Image Registration

2013-03-03 · Zhuangming Shen, Jiuai Sun, HUI ZHANG, Binjie Qin

Joint saliency map (JSM) [1] was developed to assign high joint saliency values to the corresponding saliency structures (called Joint Saliency Structures, JSSs) but zero or low joint saliency values to the outliers (or …

Image Registrationregression

Neural Pose Transfer by Spatially Adaptive Instance Normalization

2020-03-16 · CVPR 2020 6 · Jiashun Wang, Chao Wen, Yanwei Fu, Haitao Lin 외

Pose transfer has been studied for decades, in which the pose of a source mesh is applied to a target mesh. Particularly in this paper, we are interested in transferring the pose of source human mesh to deform the target…

Pose TransferStyle Transfer

Detailed Human Shape Estimation from a Single Image by Hierarchical Mesh Deformation

2019-04-24 · CVPR 2019 6 · Hao Zhu, Xinxin Zuo, Sen Wang, Xun Cao 외

This paper presents a novel framework to recover detailed human body shapes from a single image. It is a challenging task due to factors such as variations in human shapes, body poses, and viewpoints. Prior methods typic…

Boosting Adversarial Transferability across Model Genus by Deformation-Constrained Warping

2024-02-06 · Qinliang Lin, Cheng Luo, Zenghao Niu, Xilin He 외

Adversarial examples generated by a surrogate model typically exhibit limited transferability to unknown target systems. To address this problem, many transferability enhancement approaches (e.g., input transformation an…

Action Recognitionimage-classificationImage ClassificationTemporal Action Localization