paper-with-me

홈 › Papers

Content-Style Learning from Unaligned Domains: Identifiability under Unknown Latent Dimensions

2024-11-06 · Sagar Shrestha, Xiao Fu

Understanding identifiability of latent content and style variables from unaligned multi-domain data is essential for tasks such as domain translation and data generation. Existing works on content-style identification were often developed under somewhat stringent conditions, e.g., that all latent components are mutually independent and that the dimensions of the content and style variables are known. We introduce a new analytical framework via cross-domain \textit{latent distribution matching} (LDM), which establishes content-style identifiability under substantially more relaxed conditions. Specifically, we show that restrictive assumptions such as component-wise independence of the latent variables can be removed. Most notably, we prove that prior knowledge of the content and style dimensions is not necessary for ensuring identifiability, if sparsity constraints are properly imposed onto the learned latent representations. Bypassing the knowledge of the exact latent dimension has been a longstanding aspiration in unsupervised representation learning -- our analysis is the first to underpin its theoretical and practical viability. On the implementation side, we recast the LDM formulation into a regularized multi-domain GAN loss with coupled latent variables. We show that the reformulation is equivalent to LDM under mild conditions -- yet requiring considerably less computational resource. Experiments corroborate with our theoretical claims.

📄 PDF Abstract BibTeX arXiv:2411.03755

Code (0)

등록된 구현이 없습니다.

Tasks

Representation Learning

Similar Papers 제목 키워드 기반

Content-Style Identification via Differential Independence

2026-05-18 · Subash Timilsina, Hoang-Son Nguyen, Sagar Shrestha, Xiao Fu arxiv

Generative analysis often models multi-domain observations as nonlinear mixtures of domain-invariant content variables and domain-specific style variables. Identifying both factors from unpaired domains enables tasks suc…

Image Generation

Counterfactual Generation with Identifiability Guarantees

2024-02-23 · NeurIPS 2023 11 · Hanqi Yan, Lingjing Kong, Lin Gui, Yuejie Chi 외

Counterfactual generation lies at the core of various machine learning tasks, including image translation and controllable text generation. This generation process usually requires the identification of the disentangled …

counterfactualStyle TransferText Generation

Third Time's the Charm? Image and Video Editing with StyleGAN3

2022-01-31 · Yuval Alaluf, Or Patashnik, Zongze Wu, Asif Zamir 외

StyleGAN is arguably one of the most intriguing and well-studied generative models, demonstrating impressive performance in image generation, inversion, and manipulation. In this work, we explore the recent StyleGAN3 arc…

DisentanglementImage GenerationVideo Editing

Latent Covariate Shift: Unlocking Partial Identifiability for Multi-Source Domain Adaptation

2022-08-30 · Yuhang Liu, Zhen Zhang, Dong Gong, Mingming Gong 외

Multi-source domain adaptation (MSDA) addresses the challenge of learning a label prediction function for an unlabeled target domain by leveraging both the labeled data from multiple source domains and the unlabeled data…

Domain Adaptation

Towards Instance-level Image-to-Image Translation

2019-05-05 · CVPR 2019 6 · Zhiqiang Shen, Mingyang Huang, Jianping Shi, xiangyang xue 외

Unpaired Image-to-image Translation is a new rising and challenging vision problem that aims to learn a mapping between unaligned image pairs in diverse domains. Recent advances in this field like MUNIT and DRIT mainly f…

AttributeImage-to-Image Translationobject-detectionObject Detection+1