paper-with-me

홈 › Papers

CFASL: Composite Factor-Aligned Symmetry Learning for Disentanglement in Variational AutoEncoder

2024-01-17 · Hee-Jun Jung, Jaehyoung Jeong, Kangil Kim

Symmetries of input and latent vectors have provided valuable insights for disentanglement learning in VAEs. However, only a few works were proposed as an unsupervised method, and even these works require known factor information in the training data. We propose a novel method, Composite Factor-Aligned Symmetry Learning (CFASL), which is integrated into VAEs for learning symmetry-based disentanglement in unsupervised learning without any knowledge of the dataset factor information. CFASL incorporates three novel features for learning symmetry-based disentanglement: 1) Injecting inductive bias to align latent vector dimensions to factor-aligned symmetries within an explicit learnable symmetry code-book 2) Learning a composite symmetry to express unknown factors change between two random samples by learning factor-aligned symmetries within the codebook 3) Inducing a group equivariant encoder and decoder in training VAEs with the two conditions. In addition, we propose an extended evaluation metric for multi-factor changes in comparison to disentanglement evaluation in VAEs. In quantitative and in-depth qualitative analysis, CFASL demonstrates a significant improvement of disentanglement in single-factor change, and multi-factor change conditions compared to state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2401.08897

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderDisentanglementInductive Bias

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

Commutator-Induced Uncertainty in VAEs

2026-05-22 · Tahereh Dehdarirad, Michael Felsberg, Gabriel Eilertsen, Ziliang Xiong arxiv

Variational autoencoders (VAEs) often struggle to represent non-commutative structure in learned latent spaces. Symmetry-aware VAEs commonly address this issue by enforcing commutativity through algebraic regularization,…

Operationalizing Quantized Disentanglement

2025-11-25 · Vitoria Barin-Pacela, Kartik Ahuja, Simon Lacoste-Julien, Pascal Vincent arxiv

Recent theoretical work established the unsupervised identifiability of quantized factors under any diffeomorphism. The theory assumes that quantization thresholds correspond to axis-aligned discontinuities in the probab…

Disentanglement Analysis in Deep Latent Variable Models Matching Aggregate Posterior Distributions

2025-01-26 · Surojit Saha, Sarang Joshi, Ross Whitaker

Deep latent variable models (DLVMs) are designed to learn meaningful representations in an unsupervised manner, such that the hidden explanatory factors are interpretable by independent latent variables (aka disentanglem…

Disentanglement

Disentangled Representation Learning via Modular Compositional Bias

2025-10-24 · Whie Jung, Dong Hoon Lee, Seunghoon Hong arxiv

Recent disentangled representation learning (DRL) methods heavily rely on factor specific strategies-either learning objectives for attributes or model architectures for objects-to embed inductive biases. Such divergent …

Representation Learning

Disentangling Autoencoders (DAE)

2022-02-20 · Jaehoon Cha, Jeyan Thiyagalingam

Noting the importance of factorizing (or disentangling) the latent space, we propose a novel, non-probabilistic disentangling framework for autoencoders, based on the principles of symmetry transformations in group-theor…

Disentanglement