ExtSwap: Leveraging Extended Latent Mapper for Generating High Quality Face Swapping
We present a novel face swapping method using the progressively growing structure of a pre-trained StyleGAN. Previous methods use different encoder decoder structures, embedding integration networks to produce high-quality results, but their quality suffers from entangled representation. We disentangle semantics by deriving identity and attribute features separately. By learning to map the concatenated features into the extended latent space, we leverage the state-of-the-art quality and its rich semantic extended latent space. Extensive experiments suggest that the proposed method successfully disentangles identity and attribute features and outperforms many state-of-the-art face swapping methods, both qualitatively and quantitatively.
Code (1)
Tasks
AttributeDecoderFace SwappingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
V2A-Mapper: A Lightweight Solution for Vision-to-Audio Generation by Connecting Foundation Models
Building artificial intelligence (AI) systems on top of a set of foundation models (FMs) is becoming a new paradigm in AI research. Their representative and generative abilities learnt from vast amounts of data can be ea…
Audio GenerationVideo-to-Sound GenerationHigh-Fidelity 3D Facial Avatar Synthesis with Controllable Fine-Grained Expressions
Facial expression editing methods can be mainly categorized into two types based on their architectures: 2D-based and 3D-based methods. The former lacks 3D face modeling capabilities, making it difficult to edit 3D facto…
A distribution-guided Mapper algorithm
Motivation: The Mapper algorithm is an essential tool to explore shape of data in topology data analysis. With a dataset as an input, the Mapper algorithm outputs a graph representing the topological features of the whol…
Mapper Based Classifier
Topological data analysis aims to extract topological quantities from data, which tend to focus on the broader global structure of the data rather than local information. The Mapper method, specifically, generalizes clus…
ClusteringTopological Data AnalysisDeep Mapper: Efficient Visualization of Plausible Conformational Pathways
Acquiring plausible pathways on high-dimensional structural distributions is beneficial in several domains. For example, in the drug discovery field, a protein conformational pathway, i.e. a highly probable sequence of p…
Drug DiscoveryTopological Data Analysis