paper-with-me

홈 › Papers

Unsupervised discovery of the shared and private geometry in multi-view data

2024-08-22 · Sai Koukuntla, Joshua B. Julian, Jesse C. Kaminsky, Manuel Schottdorf, David W. Tank, Carlos D. Brody, Adam S. Charles

Modern applications often leverage multiple views of a subject of study. Within neuroscience, there is growing interest in large-scale simultaneous recordings across multiple brain regions. Understanding the relationship between views (e.g., the neural activity in each region recorded) can reveal fundamental principles about the characteristics of each representation and about the system. However, existing methods to characterize such relationships either lack the expressivity required to capture complex nonlinearities, describe only sources of variance that are shared between views, or discard geometric information that is crucial to interpreting the data. Here, we develop a nonlinear neural network-based method that, given paired samples of high-dimensional views, disentangles low-dimensional shared and private latent variables underlying these views while preserving intrinsic data geometry. Across multiple simulated and real datasets, we demonstrate that our method outperforms competing methods. Using simulated populations of lateral geniculate nucleus (LGN) and V1 neurons we demonstrate our model's ability to discover interpretable shared and private structure across different noise conditions. On a dataset of unrotated and corresponding but randomly rotated MNIST digits, we recover private latents for the rotated view that encode rotation angle regardless of digit class, and places the angle representation on a 1-d manifold, while shared latents encode digit class but not rotation angle. Applying our method to simultaneous Neuropixels recordings of hippocampus and prefrontal cortex while mice run on a linear track, we discover a low-dimensional shared latent space that encodes the animal's position. We propose our approach as a general-purpose method for finding succinct and interpretable descriptions of paired data sets in terms of disentangled shared and private latent variables.

📄 PDF Abstract BibTeX arXiv:2408.12091

Code (0)

등록된 구현이 없습니다.

Tasks

HippocampusRotated MNIST

Similar Papers 제목 키워드 기반

When Privacy Hurts Mergeability: Geometry-Aware Model Merging under Differential Privacy

2026-08-27 · Jin Liu, Junkang Liu, Ning Xi, Yinbin Miao 외 arxiv

Model merging promises to construct a single multi-task model from independently fine-tuned task models without accessing the original task data. This makes it attractive when task data cannot be centralized, but release…

Unsupervised Adaptation with Domain Separation Networks for Robust Speech Recognition

2017-11-21 · Zhong Meng, Zhuo Chen, Vadim Mazalov, Jinyu Li 외

Unsupervised domain adaptation of speech signal aims at adapting a well-trained source-domain acoustic model to the unlabeled data from target domain. This can be achieved by adversarial training of deep neural network (…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Domain Adaptationdomain classification+5

Unsupervised Discovery of 3D Physical Objects from Video

2020-07-24 · Yilun Du, Kevin Smith, Tomer Ulman, Joshua Tenenbaum 외

We study the problem of unsupervised physical object discovery. While existing frameworks aim to decompose scenes into 2D segments based off each object's appearance, we explore how physics, especially object interaction…

3D geometryObjectObject DiscoveryPosition

Unsupervised Multi-Target Domain Adaptation: An Information Theoretic Approach

2018-10-26 · ICLR 2019 5 · Behnam Gholami, Pritish Sahu, Ognjen Rudovic, Konstantinos Bousmalis 외

Unsupervised domain adaptation (uDA) models focus on pairwise adaptation settings where there is a single, labeled, source and a single target domain. However, in many real-world settings one seeks to adapt to multiple, …

DisentanglementDomain AdaptationMulti-target Domain AdaptationUnsupervised Domain Adaptation

Adversarial Training Based Multi-Source Unsupervised Domain Adaptation for Sentiment Analysis

2020-06-10 · Yong Dai, Jian Liu, Xiancong Ren, Zenglin Xu

Multi-source unsupervised domain adaptation (MS-UDA) for sentiment analysis (SA) aims to leverage useful information in multiple source domains to help do SA in an unlabeled target domain that has no supervised informati…

Domain AdaptationMulti-Source Unsupervised Domain AdaptationSentiment AnalysisTransfer Learning+1