paper-with-me

Papers

Diffusion-Based Generation of Neural Activity from Disentangled Latent Codes

2024-07-30 · Jonathan D. McCart, Andrew R. Sedler, Christopher Versteeg, Domenick Mifsud, Mattia Rigotti-Thompson, Chethan Pandarinath

Recent advances in recording technology have allowed neuroscientists to monitor activity from thousands of neurons simultaneously. Latent variable models are increasingly valuable for distilling these recordings into compact and interpretable representations. Here we propose a new approach to neural data analysis that leverages advances in conditional generative modeling to enable the unsupervised inference of disentangled behavioral variables from recorded neural activity. Our approach builds on InfoDiffusion, which augments diffusion models with a set of latent variables that capture important factors of variation in the data. We apply our model, called Generating Neural Observations Conditioned on Codes with High Information (GNOCCHI), to time series neural data and test its application to synthetic and biological recordings of neural activity during reaching. In comparison to a VAE-based sequential autoencoder, GNOCCHI learns higher-quality latent spaces that are more clearly structured and more disentangled with respect to key behavioral variables. These properties enable accurate generation of novel samples (unseen behavioral conditions) through simple linear traversal of the latent spaces produced by GNOCCHI. Our work demonstrates the potential of unsupervised, information-based models for the discovery of interpretable latent spaces from neural data, enabling researchers to generate high-quality samples from unseen conditions.

📄 PDF Abstract BibTeX arXiv:2407.21195

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Hierarchical Diffusion Autoencoders and Disentangled Image Manipulation

2023-04-24 · Zeyu Lu, Chengyue Wu, Xinyuan Chen, Yaohui Wang 외

Diffusion models have attained impressive visual quality for image synthesis. However, how to interpret and manipulate the latent space of diffusion models has not been extensively explored. Prior work diffusion autoenco…

Image GenerationImage ManipulationImage Reconstruction

Contrastive Diffusion Alignment: Learning Structured Latents for Controllable Generation

2025-10-16 · Ruchi Sandilya, Sumaira Perez, Charles Lynch, Lindsay Victoria 외 arxiv

Diffusion models excel at generation, but their latent spaces are high dimensional and not explicitly organized for interpretation or control. We introduce ConDA (Contrastive Diffusion Alignment), a plug-and-play geometr…

Contrastive Learning

Visual Disentangled Diffusion Autoencoders: Scalable Counterfactual Generation for Foundation Models

2026-01-29 · Sidney Bender, Marco Morik arxiv

Foundation models, despite their robust zero-shot capabilities, remain vulnerable to spurious correlations and 'Clever Hans' strategies. Existing mitigation methods often rely on unavailable group labels or computational…

Knowledge Distillation

DiffuseGAE: Controllable and High-fidelity Image Manipulation from Disentangled Representation

2023-07-12 · Yipeng Leng, Qiangjuan Huang, Zhiyuan Wang, Yangyang Liu 외

Diffusion probabilistic models (DPMs) have shown remarkable results on various image synthesis tasks such as text-to-image generation and image inpainting. However, compared to other generative methods like VAEs and GANs…

AttributeDisentanglementImage GenerationImage Inpainting+4

Neural population geometry and optimal coding of tasks with shared latent structure

2024-02-26 · Albert J. Wakhloo, Will Slatton, SueYeon Chung

Humans and animals can recognize latent structures in their environment and apply this information to efficiently navigate the world. However, it remains unclear what aspects of neural activity contribute to these comput…

Multi-Task LearningNavigate