paper-with-me

홈 › Papers

PortraitBooth: A Versatile Portrait Model for Fast Identity-preserved Personalization

2023-12-11 · CVPR 2024 1 · Xu Peng, Junwei Zhu, Boyuan Jiang, Ying Tai, Donghao Luo, Jiangning Zhang, Wei Lin, Taisong Jin, Chengjie Wang, Rongrong Ji

Recent advancements in personalized image generation using diffusion models have been noteworthy. However, existing methods suffer from inefficiencies due to the requirement for subject-specific fine-tuning. This computationally intensive process hinders efficient deployment, limiting practical usability. Moreover, these methods often grapple with identity distortion and limited expression diversity. In light of these challenges, we propose PortraitBooth, an innovative approach designed for high efficiency, robust identity preservation, and expression-editable text-to-image generation, without the need for fine-tuning. PortraitBooth leverages subject embeddings from a face recognition model for personalized image generation without fine-tuning. It eliminates computational overhead and mitigates identity distortion. The introduced dynamic identity preservation strategy further ensures close resemblance to the original image identity. Moreover, PortraitBooth incorporates emotion-aware cross-attention control for diverse facial expressions in generated images, supporting text-driven expression editing. Its scalability enables efficient and high-quality image creation, including multi-subject generation. Extensive results demonstrate superior performance over other state-of-the-art methods in both single and multiple image generation scenarios.

📄 PDF Abstract BibTeX arXiv:2312.06354

Code (0)

등록된 구현이 없습니다.

Tasks

DiversityFace RecognitionImage GenerationPersonalized Image GenerationText to Image GenerationText-to-Image Generation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

HiFi-Portrait: Zero-shot Identity-preserved Portrait Generation with High-fidelity Multi-face Fusion

2025-12-16 · Yifang Xu, Benxiang Zhai, Yunzhuo Sun, Ming Li 외 arxiv

Recent advancements in diffusion-based technologies have made significant strides, particularly in identity-preserved portrait generation (IPG). However, when using multiple reference images from the same ID, existing me…

HiFi-Portrait: Zero-shot Identity-preserved Portrait Generation with High-fidelity Multi-face Fusion

2025-01-01 · CVPR 2025 1 · Yifang Xu, Benxiang Zhai, Yunzhuo Sun, Ming Li 외

Recent advancements in diffusion-based technologies have made significant strides, particularly in identity-preserved portrait generation (IPG). However, when using multiple reference images from the same ID, existin…

FaceChain-FACT: Face Adapter with Decoupled Training for Identity-preserved Personalization

2024-10-16 · Cheng Yu, Haoyu Xie, Lei Shang, Yang Liu 외

In the field of human-centric personalized image generation, the adapter-based method obtains the ability to customize and generate portraits by text-to-image training on facial data. This allows for identity-preserved p…

DiversityImage GenerationPersonalized Image GenerationText to Image Generation+1

PuppeteerGAN: Arbitrary Portrait Animation With Semantic-Aware Appearance Transformation

2020-06-01 · CVPR 2020 6 · Zhuo Chen, Chaoyue Wang, Bo Yuan, Dacheng Tao

Portrait animation, which aims to animate a still portrait to life using poses extracted from target frames, is an important technique for many real-world entertainment applications. Although recent works have achieved h…

Portrait AnimationSegmentationSemantic Segmentation

InstructPix2NeRF: Instructed 3D Portrait Editing from a Single Image

2023-11-06 · Jianhui Li, Shilong Liu, Zidong Liu, Yikai Wang 외

With the success of Neural Radiance Field (NeRF) in 3D-aware portrait editing, a variety of works have achieved promising results regarding both quality and 3D consistency. However, these methods heavily rely on per-prom…

NeRFTriplet