paper-with-me

홈 › Papers

Multi-Modal and Multi-Attribute Generation of Single Cells with CFGen

2024-07-16 · Alessandro Palma, Till Richter, Hanyi Zhang, Manuel Lubetzki, Alexander Tong, Andrea Dittadi, Fabian Theis

Generative modeling of single-cell RNA-seq data is crucial for tasks like trajectory inference, batch effect removal, and simulation of realistic cellular data. However, recent deep generative models simulating synthetic single cells from noise operate on pre-processed continuous gene expression approximations, overlooking the discrete nature of single-cell data, which limits their effectiveness and hinders the incorporation of robust noise models. Additionally, aspects like controllable multi-modal and multi-label generation of cellular data remain underexplored. This work introduces CellFlow for Generation (CFGen), a flow-based conditional generative model that preserves the inherent discreteness of single-cell data. CFGen generates whole-genome multi-modal single-cell data reliably, improving the recovery of crucial biological data characteristics while tackling relevant generative tasks such as rare cell type augmentation and batch correction. We also introduce a novel framework for compositional data generation using Flow Matching. By showcasing CFGen on a diverse set of biological datasets and settings, we provide evidence of its value to the fields of computational biology and deep generative models.

📄 PDF Abstract BibTeX arXiv:2407.11734

Code (1)

theislab/CFGen 공식 구현 pytorch

Tasks

AttributeData Augmentation

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Contrastive Parameter Disentanglement for Multi-modal Remote Sensing Image Generation

2026-07-26 · Yu Zhang, Wenda Zhao, Haojun Tang, Haipeng Wang arxiv

Existing remote sensing image generation methods are largely confined to single-modality synthesis and therefore fail to exploit the complementary information inherent in multimodal imagery. To address this limitation, w…

Image Generation

SIGMA: Selective-Interleaved Generation with Multi-Attribute Tokens

2026-02-07 · Xiaoyan Zhang, Zechen Bai, Haofan Wang, Yiren Song arxiv

Recent unified models such as Bagel demonstrate that paired image-edit data can effectively align multiple visual tasks within a single diffusion transformer. However, these models remain limited to single-condition inpu…

Variational methods for Conditional Multimodal Deep Learning

2016-03-06 · Gaurav Pandey, Ambedkar Dukkipati

In this paper, we address the problem of conditional modality learning, whereby one is interested in generating one modality given the other. While it is straightforward to learn a joint distribution over multiple modali…

Deep LearningMultimodal Deep Learning

MIGC++: Advanced Multi-Instance Generation Controller for Image Synthesis

2024-07-02 · Dewei Zhou, You Li, Fan Ma, Zongxin Yang 외

We introduce the Multi-Instance Generation (MIG) task, which focuses on generating multiple instances within a single image, each accurately placed at predefined positions with attributes such as category, color, and sha…

AttributeImage GenerationPosition

MultiFusion: Fusing Pre-Trained Models for Multi-Lingual, Multi-Modal Image Generation

2023-05-24 · NeurIPS 2023 11 · Marco Bellagente, Manuel Brack, Hannah Teufel, Felix Friedrich 외

The recent popularity of text-to-image diffusion models (DM) can largely be attributed to the intuitive interface they provide to users. The intended generation can be expressed in natural language, with the model produc…

Image Generation