Odd-One-Out Representation Learning
The effective application of representation learning to real-world problems requires both techniques for learning useful representations, and also robust ways to evaluate properties of representations. Recent work in disentangled representation learning has shown that unsupervised representation learning approaches rely on fully supervised disentanglement metrics, which assume access to labels for ground-truth factors of variation. In many real-world cases ground-truth factors are expensive to collect, or difficult to model, such as for perception. Here we empirically show that a weakly-supervised downstream task based on odd-one-out observations is suitable for model selection by observing high correlation on a difficult downstream abstract visual reasoning task. We also show that a bespoke metric-learning VAE model which performs highly on this task also out-performs other standard unsupervised and a weakly-supervised disentanglement model across several metrics.
Code (1)
Tasks
DisentanglementMetric LearningModel SelectionOdd One OutRepresentation LearningVisual ReasoningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Multi-Representation Genetic Programming: A Case Study on Tree-based and Linear Representations
Existing genetic programming (GP) methods are typically designed based on a certain representation, such as tree-based or linear representations. These representations show various pros and cons in different domains. How…
Job Shop SchedulingSchedulingSymbolic RegressionRepresentation Fidelity:Auditing Algorithmic Decisions About Humans Using Self-Descriptions
This paper introduces a new dimension for validating algorithmic decisions about humans by measuring the fidelity of their representations. Representation Fidelity measures if decisions about a person rest on reasonable …
Empirical Evaluation and Theoretical Analysis for Representation Learning: A Survey
Representation learning enables us to automatically extract generic feature representations from a dataset to solve another machine learning task. Recently, extracted feature representations by a representation learning …
BIG-bench Machine LearningRepresentation LearningSurveyRepresentation Heterogeneity
Semantic Heterogeneity is conventionally understood as the existence of variance in the representation of a target reality when modelled, by independent parties, in different databases, schemas and/ or data. We argue tha…
DiversityUnityA survey of sparse representation: algorithms and applications
Sparse representation has attracted much attention from researchers in fields of signal processing, image processing, computer vision and pattern recognition. Sparse representation also has a good reputation in both theo…
Survey