paper-with-me

홈 › Papers

Out of Distribution Reasoning by Weakly-Supervised Disentangled Logic Variational Autoencoder

2022-10-18 · Zahra Rahiminasab, Michael Yuhas, Arvind Easwaran

Out-of-distribution (OOD) detection, i.e., finding test samples derived from a different distribution than the training set, as well as reasoning about such samples (OOD reasoning), are necessary to ensure the safety of results generated by machine learning models. Recently there have been promising results for OOD detection in the latent space of variational autoencoders (VAEs). However, without disentanglement, VAEs cannot perform OOD reasoning. Disentanglement ensures a one- to-many mapping between generative factors of OOD (e.g., rain in image data) and the latent variables to which they are encoded. Although previous literature has focused on weakly-supervised disentanglement on simple datasets with known and independent generative factors. In practice, achieving full disentanglement through weak supervision is impossible for complex datasets, such as Carla, with unknown and abstract generative factors. As a result, we propose an OOD reasoning framework that learns a partially disentangled VAE to reason about complex datasets. Our framework consists of three steps: partitioning data based on observed generative factors, training a VAE as a logic tensor network that satisfies disentanglement rules, and run-time OOD reasoning. We evaluate our approach on the Carla dataset and compare the results against three state-of-the-art methods. We found that our framework outperformed these methods in terms of disentanglement and end-to-end OOD reasoning.

📄 PDF Abstract BibTeX arXiv:2210.09959

Code (0)

등록된 구현이 없습니다.

Tasks

DisentanglementOut of Distribution (OOD) Detection

Methods 이 논문이 사용한 방법론

Entropy Regularization 설명 없음
PPO Proximal Policy Optimization, or PPO, is a policy gradient method for reinforcement learning. The motivation was to have an algorithm with the data efficiency and reliable…
Test 설명 없음
CARLA CARLA is an open-source simulator for autonomous driving research. CARLA has been developed from the ground up to support development, training, and validation of autonomous urban…

Similar Papers 제목 키워드 기반

Weakly Supervised Explainable Phrasal Reasoning with Neural Fuzzy Logic

2021-09-18 · Zijun Wu, Zi Xuan Zhang, Atharva Naik, Zhijian Mei 외

Natural language inference (NLI) aims to determine the logical relationship between two sentences, such as Entailment, Contradiction, and Neutral. In recent years, deep learning models have become a prevailing approach t…

Explanation GenerationLogical ReasoningNatural Language InferenceSentence

Odd-One-Out Representation Learning

2020-12-14 · Salman Mohammadi, Anders Kirk Uhrenholt, Bjørn Sand Jensen

The effective application of representation learning to real-world problems requires both techniques for learning useful representations, and also robust ways to evaluate properties of representations. Recent work in dis…

DisentanglementMetric LearningModel SelectionOdd One Out+2

Leveraging sparse and shared feature activations for disentangled representation learning

2023-04-17 · NeurIPS 2023 11 · Marco Fumero, Florian Wenzel, Luca Zancato, Alessandro Achille 외

Recovering the latent factors of variation of high dimensional data has so far focused on simple synthetic settings. Mostly building on unsupervised and weakly-supervised objectives, prior work missed out on the positive…

Representation Learning

Weakly-Supervised Disentanglement Without Compromises

2020-02-07 · ICML 2020 1 · Francesco Locatello, Ben Poole, Gunnar Rätsch, Bernhard Schölkopf 외

Intelligent agents should be able to learn useful representations by observing changes in their environment. We model such observations as pairs of non-i.i.d. images sharing at least one of the underlying factors of vari…

DisentanglementFairness

Weakly Supervised Disentangled Generative Causal Representation Learning

2020-10-06 · Xinwei Shen, Furui Liu, Hanze Dong, Qing Lian 외

This paper proposes a Disentangled gEnerative cAusal Representation (DEAR) learning method under appropriate supervised information. Unlike existing disentanglement methods that enforce independence of the latent variabl…

DisentanglementRepresentation Learning