paper-with-me

Papers

Two-Stream Appearance Transfer Network for Person Image Generation

2020-11-09 · Chengkang Shen, Peiyan Wang, Wei Tang

Pose guided person image generation means to generate a photo-realistic person image conditioned on an input person image and a desired pose. This task requires spatial manipulation of the source image according to the target pose. However, the generative adversarial networks (GANs) widely used for image generation and translation rely on spatially local and translation equivariant operators, i.e., convolution, pooling and unpooling, which cannot handle large image deformation. This paper introduces a novel two-stream appearance transfer network (2s-ATN) to address this challenge. It is a multi-stage architecture consisting of a source stream and a target stream. Each stage features an appearance transfer module and several two-stream feature fusion modules. The former finds the dense correspondence between the two-stream feature maps and then transfers the appearance information from the source stream to the target stream. The latter exchange local information between the two streams and supplement the non-local appearance transfer. Both quantitative and qualitative results indicate the proposed 2s-ATN can effectively handle large spatial deformation and occlusion while retaining the appearance details. It outperforms prior states of the art on two widely used benchmarks.

📄 PDF Abstract BibTeX arXiv:2011.04181

Code (0)

등록된 구현이 없습니다.

Tasks

Appearance TransferImage GenerationTranslationVocal Bursts Valence Prediction

Similar Papers 제목 키워드 기반

MUST-GAN: Multi-level Statistics Transfer for Self-driven Person Image Generation

2020-11-18 · CVPR 2021 1 · Tianxiang Ma, Bo Peng, Wei Wang, Jing Dong

Pose-guided person image generation usually involves using paired source-target images to supervise the training, which significantly increases the data preparation effort and limits the application of the models. To dea…

Image GenerationPose TransferStyle Transfer

UPGPT: Universal Diffusion Model for Person Image Generation, Editing and Pose Transfer

2023-04-18 · Soon Yau Cheong, Armin Mustafa, Andrew Gilbert

Text-to-image models (T2I) such as StableDiffusion have been used to generate high quality images of people. However, due to the random nature of the generation process, the person has a different appearance e.g. pose, f…

DisentanglementImage GenerationPose TransferText-to-Image Generation+1

Fine-Grained Shape-Appearance Mutual Learning for Cloth-Changing Person Re-Identification

2021-06-19 · CVPR 2021 1 · Peixian Hong, Tao Wu, AnCong Wu, Xintong Han 외

Recently, person re-identification (Re-ID) has achieved great progress. However, current methods largely depend on color appearance, which is not reliable when a person changes the clothes. Cloth-changing Re-ID is ch…

Cloth-Changing Person Re-IdentificationPerson Re-Identification

Learning Semantic Person Image Generation by Region-Adaptive Normalization

2021-04-14 · CVPR 2021 1 · Zhengyao Lv, Xiaoming Li, Xin Li, Fu Li 외

Human pose transfer has received great attention due to its wide applications, yet is still a challenging task that is not well solved. Recent works have achieved great success to transfer the person image from the sourc…

Image GenerationPose TransferSemantic ParsingTranslation

Text Guided Person Image Synthesis

2019-04-10 · CVPR 2019 6 · Xingran Zhou, Siyu Huang, Bin Li, Yingming Li 외

This paper presents a novel method to manipulate the visual appearance (pose and attribute) of a person image according to natural language descriptions. Our method can be boiled down to two stages: 1) text guided pose g…

AttributeImage GenerationVisual Question Answering (VQA)