Two-Stream Appearance Transfer Network for Person Image Generation
Pose guided person image generation means to generate a photo-realistic person image conditioned on an input person image and a desired pose. This task requires spatial manipulation of the source image according to the target pose. However, the generative adversarial networks (GANs) widely used for image generation and translation rely on spatially local and translation equivariant operators, i.e., convolution, pooling and unpooling, which cannot handle large image deformation. This paper introduces a novel two-stream appearance transfer network (2s-ATN) to address this challenge. It is a multi-stage architecture consisting of a source stream and a target stream. Each stage features an appearance transfer module and several two-stream feature fusion modules. The former finds the dense correspondence between the two-stream feature maps and then transfers the appearance information from the source stream to the target stream. The latter exchange local information between the two streams and supplement the non-local appearance transfer. Both quantitative and qualitative results indicate the proposed 2s-ATN can effectively handle large spatial deformation and occlusion while retaining the appearance details. It outperforms prior states of the art on two widely used benchmarks.
Code (0)
등록된 구현이 없습니다.
Tasks
Appearance TransferImage GenerationTranslationVocal Bursts Valence PredictionSimilar Papers 제목 키워드 기반
MUST-GAN: Multi-level Statistics Transfer for Self-driven Person Image Generation
Pose-guided person image generation usually involves using paired source-target images to supervise the training, which significantly increases the data preparation effort and limits the application of the models. To dea…
Image GenerationPose TransferStyle TransferUPGPT: Universal Diffusion Model for Person Image Generation, Editing and Pose Transfer
Text-to-image models (T2I) such as StableDiffusion have been used to generate high quality images of people. However, due to the random nature of the generation process, the person has a different appearance e.g. pose, f…
DisentanglementImage GenerationPose TransferText-to-Image Generation+1Fine-Grained Shape-Appearance Mutual Learning for Cloth-Changing Person Re-Identification
Recently, person re-identification (Re-ID) has achieved great progress. However, current methods largely depend on color appearance, which is not reliable when a person changes the clothes. Cloth-changing Re-ID is ch…
Cloth-Changing Person Re-IdentificationPerson Re-IdentificationLearning Semantic Person Image Generation by Region-Adaptive Normalization
Human pose transfer has received great attention due to its wide applications, yet is still a challenging task that is not well solved. Recent works have achieved great success to transfer the person image from the sourc…
Image GenerationPose TransferSemantic ParsingTranslationText Guided Person Image Synthesis
This paper presents a novel method to manipulate the visual appearance (pose and attribute) of a person image according to natural language descriptions. Our method can be boiled down to two stages: 1) text guided pose g…
AttributeImage GenerationVisual Question Answering (VQA)