Attention-based Fusion for Multi-source Human Image Generation
We present a generalization of the person-image generation task, in which a human image is generated conditioned on a target pose and a set X of source appearance images. In this way, we can exploit multiple, possibly complementary images of the same person which are usually available at training and at testing time. The solution we propose is mainly based on a local attention mechanism which selects relevant information from different source image regions, avoiding the necessity to build specific generators for each specific cardinality of X. The empirical evaluation of our method shows the practical interest of addressing the person-image generation problem in a multi-source setting.
Code (0)
등록된 구현이 없습니다.
Tasks
Image GenerationSimilar Papers 제목 키워드 기반
Non-linear and Selective Fusion of Cross-Modal Images
The human visual perception system has strong robustness in image fusion. This robustness is based on human visual perception system's characteristics of feature selection and non-linear fusion of different features. In …
feature selectionTruePose: Human-Parsing-guided Attention Diffusion for Full-ID Preserving Pose Transfer
Pose-Guided Person Image Synthesis (PGPIS) generates images that maintain a subject's identity from a source image while adopting a specified target pose (e.g., skeleton). While diffusion-based PGPIS methods effectively …
DenoisingHuman ParsingImage GenerationPose TransferCross-Modal Image Fusion Theory Guided by Subjective Visual Attention
The human visual perception system has very strong robustness and contextual awareness in a variety of image processing tasks. This robustness and the perception ability of contextual awareness is closely related to the …
Auxiliary LearningMEAT: Multiview Diffusion Model for Human Generation on Megapixels with Mesh Attention
Multiview diffusion models have shown considerable success in image-to-3D generation for general objects. However, when applied to human data, existing methods have yet to deliver promising results, largely due to the ch…
3D GenerationImage to 3DFDA-GAN: Flow-based Dual Attention GAN for Human Pose Transfer
Human pose transfer aims at transferring the appearance of the source person to the target pose. Existing methods utilizing flow-based warping for non-rigid human image generation have achieved great success. However, th…
Image GenerationPose Transfer