paper-with-me

홈 › Papers

Multimodal Data Visualization and Denoising with Integrated Diffusion

2021-02-12 · Manik Kuchroo, Abhinav Godavarthi, Alexander Tong, Guy Wolf, Smita Krishnaswamy

We propose a method called integrated diffusion for combining multimodal datasets, or data gathered via several different measurements on the same system, to create a joint data diffusion operator. As real world data suffers from both local and global noise, we introduce mechanisms to optimally calculate a diffusion operator that reflects the combined information from both modalities. We show the utility of this joint operator in data denoising, visualization and clustering, performing better than other methods to integrate and analyze multimodal data. We apply our method to multi-omic data generated from blood cells, measuring both gene expression and chromatin accessibility. Our approach better visualizes the geometry of the joint data, captures known cross-modality associations and identifies known cellular populations. More generally, integrated diffusion is broadly applicable to multimodal datasets generated in many medical and biological systems.

📄 PDF Abstract BibTeX arXiv:2102.06757

Code (0)

등록된 구현이 없습니다.

Tasks

ClusteringData VisualizationDenoising

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

PlayFusion: Skill Acquisition via Diffusion from Language-Annotated Play

2023-12-07 · Lili Chen, Shikhar Bahl, Deepak Pathak

Learning from unstructured and uncurated data has become the dominant paradigm for generative approaches in language and vision. Such unstructured and unguided behavior data, commonly known as play, is also easier to col…

Denoising

Tackling the Generative Learning Trilemma with Denoising Diffusion GANs

2021-12-15 · ICLR 2022 4 · Zhisheng Xiao, Karsten Kreis, Arash Vahdat

A wide variety of deep generative models has been developed in the past decade. Yet, these models often struggle with simultaneously addressing three key requirements including: high sample quality, mode coverage, and fa…

DiversityImage Generation

Novel Diffusion Models for Multimodal 3D Hand Trajectory Prediction

2025-04-10 · Junyi Ma, Wentao Bao, Jingyi Xu, Guanzhong Sun 외

Predicting hand motion is critical for understanding human intentions and bridging the action space between human movements and robot manipulations. Existing hand trajectory prediction (HTP) methods forecast the future h…

DenoisingMambaTrajectory Prediction

Denoising Diffusions with Optimal Transport: Localization, Curvature, and Multi-Scale Complexity

2024-11-03 · Tengyuan Liang, Kulunu Dharmakeerthi, Takuya Koriyama

Adding noise is easy; what about denoising? Diffusion is easy; what about reverting a diffusion? Diffusion-based generative models aim to denoise a Langevin diffusion chain, moving from a log-concave equilibrium measure …

Denoising

Particle Denoising Diffusion Sampler

2024-02-09 · Angus Phillips, Hai-Dang Dau, Michael John Hutchinson, Valentin De Bortoli 외

Denoising diffusion models have become ubiquitous for generative modeling. The core idea is to transport the data distribution to a Gaussian by using a diffusion. Approximate samples from the data distribution are then o…

Denoising