paper-with-me

홈 › Papers

Semantically Informed Salient Regions Guided Radiology Report Generation

2025-07-15 · Zeyi Hou, Zeqiang Wei, Ruixin Yan, Ning Lang, Xiuzhuang Zhou

Recent advances in automated radiology report generation from chest X-rays using deep learning algorithms have the potential to significantly reduce the arduous workload of radiologists. However, due to the inherent massive data bias in radiology images, where abnormalities are typically subtle and sparsely distributed, existing methods often produce fluent yet medically inaccurate reports, limiting their applicability in clinical practice. To address this issue effectively, we propose a Semantically Informed Salient Regions-guided (SISRNet) report generation method. Specifically, our approach explicitly identifies salient regions with medically critical characteristics using fine-grained cross-modal semantics. Then, SISRNet systematically focuses on these high-information regions during both image modeling and report generation, effectively capturing subtle abnormal findings, mitigating the negative impact of data bias, and ultimately generating clinically accurate reports. Compared to its peers, SISRNet demonstrates superior performance on widely used IU-Xray and MIMIC-CXR datasets.

📄 PDF Abstract BibTeX arXiv:2507.11015

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Interactive and Explainable Region-guided Radiology Report Generation

2023-04-17 · CVPR 2023 1 · Tim Tanida, Philip Müller, Georgios Kaissis, Daniel Rueckert

The automatic generation of radiology reports has the potential to assist radiologists in the time-consuming task of report writing. Existing methods generate the full report from image-level features, failing to explici…

Medical Report Generation

Combating Visual Neglect and Semantic Drift in Large Multimodal Models for Enhanced Cross-Modal Retrieval

2026-04-28 · Guosheng Zhang, Linkai Liu, Keyao Wang, Haixiao Yue 외 arxiv

Despite significant progress in Unified Multimodal Retrieval (UMR) powered by Large Multimodal Models (LMMs), existing embedding methods primarily focus on sample-level objectives via contrastive learning while overlooki…

Representation LearningCross-Modal RetrievalContrastive Learning

Rethinking of the Image Salient Object Detection: Object-level Semantic Saliency Re-ranking First, Pixel-wise Saliency Refinement Latter

2020-08-10 · Zhen-Yu Wu, Shuai Li, Chenglizhao Chen, Aimin Hao 외

The real human attention is an interactive activity between our visual system and our brain, using both low-level visual stimulus and high-level semantic information. Previous image salient object detection (SOD) works c…

Objectobject-detectionObject DetectionRe-Ranking+2

RadDiff: Describing Differences in Radiology Image Sets with Natural Language

2026-01-07 · Xiaoxian Shen, Yuhui Zhang, Sahithi Ankireddy, Xiaohan Wang 외 arxiv

Understanding how two radiology image sets differ is critical for generating clinical insights and for interpreting medical AI systems. We introduce RadDiff, a multimodal agentic system that performs radiologist-style co…

Natural Language UnderstandingMultimodal Reasoning

ASAP: Advancing Medical Volumetric Representation Learning with Anatomy-aware Semantically-adaptive Pre-training

2026-05-30 · Rongsheng Wang, Fenghe Tang, Zihang Jiang, Yingtai Li 외 arxiv

Learning transferable and interpretable representations from medical volumetric scans remains challenging due to complex anatomical structures and weak, heterogeneous supervision provided by radiology reports. In this pa…

Visual Question AnsweringRepresentation LearningCross-Modal Retrieval