paper-with-me

홈 › Papers

Multimodal 3D Genome Pre-training

2025-04-12 · Minghao Yang, Pengteng Li, Yan Liang, Qianyi Cai, Zhihang Zheng, Shichen Zhang, Pengfei Zhang, Zhi-An Huang, Hui Xiong

Deep learning techniques have driven significant progress in various analytical tasks within 3D genomics in computational biology. However, a holistic understanding of 3D genomics knowledge remains underexplored. Here, we propose MIX-HIC, the first multimodal foundation model of 3D genome that integrates both 3D genome structure and epigenomic tracks, which obtains unified and comprehensive semantics. For accurate heterogeneous semantic fusion, we design the cross-modal interaction and mapping blocks for robust unified representation, yielding the accurate aggregation of 3D genome knowledge. Besides, we introduce the first large-scale dataset comprising over 1 million pairwise samples of Hi-C contact maps and epigenomic tracks for high-quality pre-training, enabling the exploration of functional implications in 3D genomics. Extensive experiments show that MIX-HIC can significantly surpass existing state-of-the-art methods in diverse downstream tasks. This work provides a valuable resource for advancing 3D genomics research.

📄 PDF Abstract BibTeX arXiv:2504.09060

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Hindi Visual Genome: A Dataset for Multimodal English-to-Hindi Machine Translation

2019-07-21 · Shantipriya Parida, Ondřej Bojar, Satya Ranjan Dash

Visual Genome is a dataset connecting structured image information with English language. We present ``Hindi Visual Genome'', a multimodal dataset consisting of text and images suitable for English-Hindi multimodal machi…

Machine TranslationMultimodal Machine TranslationTranslation

Social Genome: Grounded Social Reasoning Abilities of Multimodal Models

2025-02-21 · Leena Mathur, Marian Qian, Paul Pu Liang, Louis-Philippe Morency

Social reasoning abilities are crucial for AI systems to effectively interpret and respond to multimodal human communication and interaction within social contexts. We introduce SOCIAL GENOME, the first benchmark for fin…

scFusionTTT: Single-cell transcriptomics and proteomics fusion with Test-Time Training layers

2024-10-17 · Dian Meng, Bohao Xing, Xinlei Huang, Yanran Liu 외

Single-cell multi-omics (scMulti-omics) refers to the paired multimodal data, such as Cellular Indexing of Transcriptomes and Epitopes by Sequencing (CITE-seq), where the regulation of each cell was measured from differe…

VGStore: A Multimodal Extension to SPARQL for Querying RDF Scene Graph

2022-09-07 · Yanzeng Li, Zilong Zheng, Wenjuan Han, Lei Zou

Semantic Web technology has successfully facilitated many RDF models with rich data representation methods. It also has the potential ability to represent and store multimodal knowledge bases such as multimodal scene gra…

Relational ReasoningSemantic SimilaritySemantic Textual Similarity

English to Bengali Multimodal Neural Machine Translation using Transliteration-based Phrase Pairs Augmentation

2022-10-01 · WAT 2022 10 · Sahinur Rahman Laskar, Pankaj Dadure, Riyanka Manna, Partha Pakray 외

Automatic translation of one natural language to another is a popular task of natural language processing. Although the deep learning-based technique known as neural machine translation (NMT) is a widely accepted machine…

Machine TranslationNMTTranslationTransliteration