paper-with-me

Papers

TC-VAE: Uncovering Out-of-Distribution Data Generative Factors

2023-04-08 · Cristian Meo, Anirudh Goyal, Justin Dauwels

Uncovering data generative factors is the ultimate goal of disentanglement learning. Although many works proposed disentangling generative models able to uncover the underlying generative factors of a dataset, so far no one was able to uncover OOD generative factors (i.e., factors of variations that are not explicitly shown on the dataset). Moreover, the datasets used to validate these models are synthetically generated using a balanced mixture of some predefined generative factors, implicitly assuming that generative factors are uniformly distributed across the datasets. However, real datasets do not present this property. In this work we analyse the effect of using datasets with unbalanced generative factors, providing qualitative and quantitative results for widely used generative models. Moreover, we propose TC-VAE, a generative model optimized using a lower bound of the joint total correlation between the learned latent representations and the input data. We show that the proposed model is able to uncover OOD generative factors on different datasets and outperforms on average the related baselines in terms of downstream disentanglement metrics.

📄 PDF Abstract BibTeX arXiv:2304.04103

Code (0)

등록된 구현이 없습니다.

Tasks

Disentanglement

Similar Papers 제목 키워드 기반

Uncovering Physical Drivers of Dark Matter Halo Structures with Auxiliary-Variable-Guided Generative Models

2026-02-26 · Arkaprabha Ganguli, Anirban Samaddar, Florian Kéruzoré, Nesar Ramachandra 외 arxiv

Deep generative models (DGMs) compress high-dimensional data but often entangle distinct physical factors in their latent spaces. We present an auxiliary-variable-guided framework for disentangling representations of the…

A flow-based latent state generative model of neural population responses to natural images

2021-12-01 · NeurIPS 2021 12 · Mohammad Bashiri, Edgar Walker, Konstantin-Klemens Lurz, Akshay Jagadish 외

We present a joint deep neural system identification model for two major sources of neural variability: stimulus-driven and stimulus-conditioned fluctuations. To this end, we combine (1) state-of-the-art deep networks fo…

Pupil Dilation

A Non-negative VAE:the Generalized Gamma Belief Network

2024-08-06 · Zhibin Duan, Tiansheng Wen, Muyao Wang, Bo Chen 외

The gamma belief network (GBN), often regarded as a deep topic model, has demonstrated its potential for uncovering multi-layer interpretable latent representations in text data. Its notable capability to acquire interpr…

Representation LearningVariational Inference

Exploring Causes of Representational Similarity in Machine Learning Models

2025-05-20 · Zeyu Michael Li, Hung Anh Vu, Damilola Awofisayo, Emily Wenger

Numerous works have noted significant similarities in how machine learning models represent the world, even across modalities. Although much effort has been devoted to uncovering properties and metrics on which these mod…

Out of Distribution Reasoning by Weakly-Supervised Disentangled Logic Variational Autoencoder

2022-10-18 · Zahra Rahiminasab, Michael Yuhas, Arvind Easwaran

Out-of-distribution (OOD) detection, i.e., finding test samples derived from a different distribution than the training set, as well as reasoning about such samples (OOD reasoning), are necessary to ensure the safety of …

DisentanglementOut of Distribution (OOD) Detection