paper-with-me

Papers

MUDI: A Multimodal Biomedical Dataset for Understanding Pharmacodynamic Drug-Drug Interactions

2025-06-02 · Tung-Lam Ngo, Ba-Hoang Tran, Duy-Cat Can, Trung-Hieu Do, Oliver Y. Chén, Hoang-Quynh Le

Understanding the interaction between different drugs (drug-drug interaction or DDI) is critical for ensuring patient safety and optimizing therapeutic outcomes. Existing DDI datasets primarily focus on textual information, overlooking multimodal data that reflect complex drug mechanisms. In this paper, we (1) introduce MUDI, a large-scale Multimodal biomedical dataset for Understanding pharmacodynamic Drug-drug Interactions, and (2) benchmark learning methods to study it. In brief, MUDI provides a comprehensive multimodal representation of drugs by combining pharmacological text, chemical formulas, molecular structure graphs, and images across 310,532 annotated drug pairs labeled as Synergism, Antagonism, or New Effect. Crucially, to effectively evaluate machine-learning based generalization, MUDI consists of unseen drug pairs in the test set. We evaluate benchmark models using both late fusion voting and intermediate fusion strategies. All data, annotations, evaluation scripts, and baselines are released under an open research license.

📄 PDF Abstract BibTeX arXiv:2506.01478

Code (1)

hoangbros03/MUDI 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Coordinated Multi-Robot Disassembly for Makespan Optimization of Large-Scale Assemblies

2026-08-06 · Niklas Hargus, Andreas Orthey, Marc Toussaint arxiv

Multi-robot task and motion planning for disassembly tasks requires robots to operate in confined workspaces while coordinating their motions with other robots. To tackle this problem, we propose a planning method called…

Motion Planning

Doctor Sun: A Bilingual Multimodal Large Language Model for Biomedical AI

2025-07-30 · Dong Xue, Ziyao Shao, Zhaoyang Duan, Fangzhou Liu 외 arxiv

Large multimodal models (LMMs) have demonstrated significant potential in providing innovative solutions for various biomedical tasks, including pathology analysis, radiology report generation, and biomedical assistance.…

MuDiT & MuSiT: Alignment with Colloquial Expression in Description-to-Song Generation

2024-07-03 · ZiHao Wang, Haoxuan Liu, Jiaxing Yu, Tao Zhang 외

Amid the rising intersection of generative AI and human artistic processes, this study probes the critical yet less-explored terrain of alignment in human-centric automatic song composition. We propose a novel task of Co…

DescriptiveRhythm

Causal Representation Learning from Multimodal Biomedical Observations

2024-11-10 · Yuewen Sun, Lingjing Kong, Guangyi Chen, Loka Li 외

Prevalent in biomedical applications (e.g., human phenotype research), multimodal datasets can provide valuable insights into the underlying physiological mechanisms. However, current machine learning (ML) models designe…

Representation Learning

LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Day

2023-06-01 · NeurIPS 2023 11 · Chunyuan Li, Cliff Wong, Sheng Zhang, Naoto Usuyama 외

Conversational generative AI has demonstrated remarkable promise for empowering biomedical practitioners, but current investigations focus on unimodal text. Multimodal conversational AI has seen rapid progress by leverag…

Image ClassificationInstruction FollowingLanguage ModellingQuestion Answering+3