paper-with-me

홈 › Papers

FlashFace: Human Image Personalization with High-fidelity Identity Preservation

2024-03-25 · Shilong Zhang, Lianghua Huang, Xi Chen, Yifei Zhang, Zhi-Fan Wu, Yutong Feng, Wei Wang, Yujun Shen, Yu Liu, Ping Luo

This work presents FlashFace, a practical tool with which users can easily personalize their own photos on the fly by providing one or a few reference face images and a text prompt. Our approach is distinguishable from existing human photo customization methods by higher-fidelity identity preservation and better instruction following, benefiting from two subtle designs. First, we encode the face identity into a series of feature maps instead of one image token as in prior arts, allowing the model to retain more details of the reference faces (e.g., scars, tattoos, and face shape ). Second, we introduce a disentangled integration strategy to balance the text and image guidance during the text-to-image generation process, alleviating the conflict between the reference faces and the text prompts (e.g., personalizing an adult into a "child" or an "elder"). Extensive experimental results demonstrate the effectiveness of our method on various applications, including human image personalization, face swapping under language prompts, making virtual characters into real people, etc. Project Page: https://jshilong.github.io/flashface-page.

📄 PDF Abstract BibTeX arXiv:2403.17008

Code (1)

ali-vilab/FlashFace pytorch

Tasks

Face SwappingImage GenerationInstruction FollowingText to Image GenerationText-to-Image Generation

Similar Papers 제목 키워드 기반

DynamicID: Zero-Shot Multi-ID Image Personalization with Flexible Facial Editability

2025-03-09 · Xirui Hu, Jiahao Wang, Hao Chen, Weizhan Zhang 외

Recent advancements in text-to-image generation have spurred interest in personalized human image generation, which aims to create novel images featuring specific human identities as reference images indicate. Although e…

Contrastive LearningFacial EditingImage GenerationText to Image Generation+1

ACCORD: Alleviating Concept Coupling through Dependence Regularization for Text-to-Image Diffusion Personalization

2025-03-03 · Shizhan Liu, Hao Zheng, Hang Yu, Jianguo Li

Image personalization has garnered attention for its ability to customize Text-to-Image generation using only a few reference images. However, a key challenge in image personalization is the issue of conceptual coupling,…

DenoisingDiffusion PersonalizationImage GenerationText to Image Generation+1

AnyStory: Towards Unified Single and Multiple Subject Personalization in Text-to-Image Generation

2025-01-16 · Junjie He, Yuxiang Tuo, Binghui Chen, Chongyang Zhong 외

Recently, large-scale generative models have demonstrated outstanding text-to-image generation capabilities. However, generating high-fidelity personalized images with specific subjects still presents challenges, especia…

Image GenerationText to Image GenerationText-to-Image Generation

HOMIE: Human-object Centric Video Personalization via Multimodal Intelligent Enchancement

2026-07-20 · Yiyang Cai, Nan Chen, Rongchang Xie, Junwen Pan 외 hf

Human-object centric video personalization (HOCVP) is a core task within subject-driven video generation. However, existing methods suffer from two key limitations. First, most approaches focusing on inter-subject person…

Video Generation

Omni-Attribute: Open-vocabulary Attribute Encoder for Visual Concept Personalization

2025-12-11 · Tsai-Shien Chen, Aliaksandr Siarohin, Gordon Guocheng Qian, Kuan-Chieh Jackson Wang 외 arxiv

Visual concept personalization aims to transfer only specific image attributes, such as identity, expression, lighting, and style, into unseen contexts. However, existing methods rely on holistic embeddings from general-…