paper-with-me

Papers

DiffSwap++: 3D Latent-Controlled Diffusion for Identity-Preserving Face Swapping

2025-11-04 · Weston Bondurant, Arkaprava Sinha, Hieu Le, Srijan Das, Stephanie Schuckers arxiv

Diffusion-based approaches have recently achieved strong results in face swapping, offering improved visual quality over traditional GAN-based methods. However, even state-of-the-art models often suffer from fine-grained artifacts and poor identity preservation, particularly under challenging poses and expressions. A key limitation of existing approaches is their failure to meaningfully leverage 3D facial structure, which is crucial for disentangling identity from pose and expression. In this work, we propose DiffSwap++, a novel diffusion-based face-swapping pipeline that incorporates 3D facial latent features during training. By guiding the generation process with 3D-aware representations, our method enhances geometric consistency and improves the disentanglement of facial identity from appearance attributes. We further design a diffusion architecture that conditions the denoising process on both identity embeddings and facial landmarks, enabling high-fidelity and identity-preserving face swaps. Extensive experiments on CelebA, FFHQ, and CelebV-Text demonstrate that DiffSwap++ outperforms prior methods in preserving source identity while maintaining target pose and expression. Additionally, we introduce a biometric-style evaluation and conduct a user study to further validate the realism and effectiveness of our approach. Code will be made publicly available at https://github.com/WestonBond/DiffSwapPP

📄 PDF Abstract BibTeX arXiv:2511.05575

Code (0)

등록된 구현이 없습니다.

Tasks

Face Swapping

Similar Papers 제목 키워드 기반

DiffSwap: High-Fidelity and Controllable Face Swapping via 3D-Aware Masked Diffusion

2023-01-01 · CVPR 2023 1 · Wenliang Zhao, Yongming Rao, Weikang Shi, Zuyan Liu 외

In this paper, we propose DiffSwap, a diffusion model based framework for high-fidelity and controllable face swapping. Unlike previous work that relies on carefully designed network architectures and loss functions …

Face Swapping

Face inpainting with Identity Preserving Latent Diffusion Models

2026-05-15 · João Santos, Carlos Santiago, Manuel Marques arxiv

Face inpainting techniques recover missing or occluded facial regions in a visually realistic manner, but preserving the identity in the final output remains a fundamental challenge. Identity consistency is crucial for d…

Face RecognitionImage Inpainting

Black Hole-Driven Identity Absorbing in Diffusion Models

2025-01-01 · CVPR 2025 1 · Muhammad Shaheryar, Jong Taek Lee, Soon Ki Jung

Recent advances in diffusion models have positioned them as powerful generative frameworks for high-resolution image synthesis across diverse domains. The emerging h-space within these models, defined by bottleneck a…

DisentanglementImage Generation

FLUID: Training-Free Face De-identification via Latent Identity Substitution

2025-11-21 · Jinhyeong Park, Shaheryar Muhammad, Seangmin Lee, Jong Taek Lee 외 arxiv

Current face de-identification methods that replace identifiable cues in the face region with other sacrifices utilities contributing to realism, such as age and gender. To retrieve the damaged realism, we present FLUID …

Image Editing

Beyond Inference Intervention: Identity-Decoupled Diffusion for Face Anonymization

2025-10-28 · Haoxin Yang, Yihong Lin, Jingdan Kang, Xuemiao Xu 외 arxiv

Face anonymization aims to conceal identity information while preserving non-identity attributes. Mainstream diffusion models rely on inference-time interventions such as negative guidance or energy-based optimization, w…

Face Anonymization