paper-with-me

홈 › Papers

DALL-M: Context-Aware Clinical Data Augmentation with LLMs

2024-07-11 · Chihcheng Hsieh, Catarina Moreira, Isabel Blanco Nobre, Sandra Costa Sousa, Chun Ouyang, Margot Brereton, Joaquim Jorge, Jacinto C. Nascimento

X-ray images are vital in medical diagnostics, but their effectiveness is limited without clinical context. Radiologists often find chest X-rays insufficient for diagnosing underlying diseases, necessitating the integration of structured clinical features with radiology reports. To address this, we introduce DALL-M, a novel framework that enhances clinical datasets by generating contextual synthetic data. DALL-M augments structured patient data, including vital signs (e.g., heart rate, oxygen saturation), radiology findings (e.g., lesion presence), and demographic factors. It integrates this tabular data with contextual knowledge extracted from radiology reports and domain-specific resources (e.g., Radiopaedia, Wikipedia), ensuring clinical consistency and reliability. DALL-M follows a three-phase process: (i) clinical context storage, (ii) expert query generation, and (iii) context-aware feature augmentation. Using large language models (LLMs), it generates both contextual synthetic values for existing clinical features and entirely new, clinically relevant features. Applied to 799 cases from the MIMIC-IV dataset, DALL-M expanded the original 9 clinical features to 91. Empirical validation with machine learning models (including Decision Trees, Random Forests, XGBoost, and TabNET) demonstrated a 16.5% improvement in F1 score and a 25% increase in Precision and Recall. DALL-M bridges an important gap in clinical data augmentation by preserving data integrity while enhancing predictive modeling in healthcare. Our results show that integrating LLM-generated synthetic features significantly improves model performance, making DALL-M a scalable and practical approach for AI-driven medical diagnostics.

📄 PDF Abstract BibTeX arXiv:2407.08227

Code (1)

chihchenghsieh/dall-m 공식 구현

Tasks

Data AugmentationData Integration

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

EM-Paste: EM-guided Cut-Paste with DALL-E Augmentation for Image-level Weakly Supervised Instance Segmentation

2022-12-15 · Yunhao Ge, Jiashu Xu, Brian Nlong Zhao, Laurent Itti 외

We propose EM-PASTE: an Expectation Maximization(EM) guided Cut-Paste compositional dataset augmentation approach for weakly-supervised instance segmentation using only image-level supervision. The proposed method consis…

Instance SegmentationObjectRegion ProposalSegmentation+2

Bridging the gap between AI and Healthcare sides: towards developing clinically relevant AI-powered diagnosis systems

2020-01-12 · Changhee Han, Leonardo Rundo, Kohei Murao, Takafumi Nemoto 외

Despite the success of Convolutional Neural Network-based Computer-Aided Diagnosis research, its clinical applications remain challenging. Accordingly, developing medical Artificial Intelligence (AI) fitting into a clini…

Data AugmentationGenerative Adversarial NetworkImage AugmentationImage Generation

Context-Aware Sequence Alignment using 4D Skeletal Augmentation

2022-04-26 · CVPR 2022 1 · Taein Kwon, Bugra Tekin, Siyu Tang, Marc Pollefeys

Temporal alignment of fine-grained human actions in videos is important for numerous applications in computer vision, robotics, and mixed reality. State-of-the-art methods directly learn image-based embedding space by le…

Hand Pose EstimationMixed RealityPose EstimationSelf-Supervised Learning

Mitigating Data Scarcity in Psychological Defense Classification with Context-Aware Synthetic Augmentation

2026-05-14 · Hoang-Thuy-Duong Vu, Quoc-Cuong Pham, Huy-Hieu Pham arxiv

Psychological defense mechanisms (PDMs) are unconscious cognitive processes that modulate how individuals perceive and respond to emotional distress. Automatically classifying PDMs from text is clinically valuable but se…

CRIMSON: A Clinically-Grounded LLM-Based Metric for Generative Radiology Report Evaluation

2026-03-06 · Mohammed Baharoon, Thibault Heintz, Siavash Raissi, Mahmoud Alabbad 외 arxiv

We introduce CRIMSON, a clinically grounded evaluation framework for chest X-ray report generation that assesses reports based on diagnostic correctness, contextual relevance, and patient safety. Unlike prior metrics, CR…