paper-with-me

Papers

Representation Learning Through Latent Canonicalizations

2020-02-26 · Or Litany, Ari Morcos, Srinath Sridhar, Leonidas Guibas, Judy Hoffman

We seek to learn a representation on a large annotated data source that generalizes to a target domain using limited new supervision. Many prior approaches to this problem have focused on learning "disentangled" representations so that as individual factors vary in a new domain, only a portion of the representation need be updated. In this work, we seek the generalization power of disentangled representations, but relax the requirement of explicit latent disentanglement and instead encourage linearity of individual factors of variation by requiring them to be manipulable by learned linear transformations. We dub these transformations latent canonicalizers, as they aim to modify the value of a factor to a pre-determined (but arbitrary) canonical value (e.g., recoloring the image foreground to black). Assuming a source domain with access to meta-labels specifying the factors of variation within an image, we demonstrate experimentally that our method helps reduce the number of observations needed to generalize to a similar target domain when compared to a number of supervised baselines.

📄 PDF Abstract BibTeX arXiv:2002.11829

Code (0)

등록된 구현이 없습니다.

Tasks

DisentanglementRepresentation Learning

Similar Papers 제목 키워드 기반

Weisfeiler-Leman Is Incomplete on Simple Spectrum Graphs, so Canonicalize Them

2026-05-22 · Snir Hordan, Nadav Dym, Tim Seppelt arxiv

Graphs with a simple spectrum admit cubic-time isomorphism testing, yet we prove that for every natural number $k$, the $k$-Weisfeiler-Leman ($k$-WL) test cannot distinguish all non-isomorphic graphs with a simple spectr…

Graph Regression

Platonic Projection Structures: Operator-Induced Observability in Representation Learning

2026-07-06 · Kazuo Ishii, Bishnu Prasad Gautam, Jieling Wu, Javaid Saher arxiv

We characterize observability in representation learning through Platonic Projection Structures (PPS), an operator-theoretic framework for analyzing representation accessibility under partial observation. Rather than tre…

Representation LearningKnowledge Distillation

Constrained latent state modeling: A unifying perspective on representation learning under competing constraints

2026-05-15 · Gwenolé Quellec arxiv

Learning latent representations from complex data is central to modern machine learning, spanning temporal, multimodal, and partially observed systems. In such settings, representations are more naturally understood as l…

Representation Learning

Differentiable Autoencoding Neural Operator for Interpretable and Integrable Latent Space Modeling

2025-09-30 · Siva Viknesh, Amirhossein Arzani arxiv

Scientific machine learning has enabled the extraction of physical insights and data-driven modeling of high-dimensional spatiotemporal data, yet achieving physically interpretable latent representations and computationa…

How to Blend Concepts in Diffusion Models

2024-07-19 · Lorenzo Olearo, Giorgio Longari, Simone Melzi, Alessandro Raganato 외

For the last decade, there has been a push to use multi-dimensional (latent) spaces to represent concepts; and yet how to manipulate these concepts or reason with them remains largely unclear. Some recent methods exploit…

Image Reconstruction