paper-with-me

홈 › Papers

PriorRG: Prior-Guided Contrastive Pre-training and Coarse-to-Fine Decoding for Chest X-ray Report Generation

2025-08-07 · Kang Liu, Zhuoqi Ma, Zikang Fang, Yunan Li, Kun Xie, Qiguang Miao arxiv

Chest X-ray report generation aims to reduce radiologists' workload by automatically producing high-quality preliminary reports. A critical yet underexplored aspect of this task is the effective use of patient-specific prior knowledge -- including clinical context (e.g., symptoms, medical history) and the most recent prior image -- which radiologists routinely rely on for diagnostic reasoning. Most existing methods generate reports from single images, neglecting this essential prior information and thus failing to capture diagnostic intent or disease progression. To bridge this gap, we propose PriorRG, a novel chest X-ray report generation framework that emulates real-world clinical workflows via a two-stage training pipeline. In Stage 1, we introduce a prior-guided contrastive pre-training scheme that leverages clinical context to guide spatiotemporal feature extraction, allowing the model to align more closely with the intrinsic spatiotemporal semantics in radiology reports. In Stage 2, we present a prior-aware coarse-to-fine decoding for report generation that progressively integrates patient-specific prior knowledge with the vision encoder's hidden states. This decoding allows the model to align with diagnostic focus and track disease progression, thereby enhancing the clinical accuracy and fluency of the generated reports. Extensive experiments on MIMIC-CXR and MIMIC-ABN datasets demonstrate that PriorRG outperforms state-of-the-art methods, achieving a 3.6% BLEU-4 and 3.8% F1 score improvement on MIMIC-CXR, and a 5.9% BLEU-1 gain on MIMIC-ABN. Code and checkpoints will be released upon acceptance.

📄 PDF Abstract BibTeX arXiv:2508.05353

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval

2022-07-15 · Yiwei Ma, Guohai Xu, Xiaoshuai Sun, Ming Yan 외

Video-text retrieval has been a crucial and fundamental task in multi-modal research. The development of video-text retrieval has been considerably promoted by large-scale multi-modal contrastive pre-training, which prim…

Contrastive LearningRetrievalText RetrievalVideo Retrieval+1

Advancing Multi-grained Alignment for Contrastive Language-Audio Pre-training

2024-08-15 · Yiming Li, Zhifang Guo, Xiangdong Wang, Hong Liu

Recent advances have been witnessed in audio-language joint learning, such as CLAP, that shows much success in multi-modal understanding tasks. These models usually aggregate uni-modal local representations, namely frame…

cross-modal alignment

WDMamba: When Wavelet Degradation Prior Meets Vision Mamba for Image Dehazing

2025-05-07 · Jie Sun, Heng Liu, Yongzhen Wang, Xiao-Ping Zhang 외

In this paper, we reveal a novel haze-specific wavelet degradation prior observed through wavelet transform analysis, which shows that haze-related information predominantly resides in low-frequency components. Exploitin…

Image DehazingMamba

Efficient Token-Guided Image-Text Retrieval with Consistent Multimodal Contrastive Training

2023-06-15 · Chong Liu, Yuqi Zhang, Hongsong Wang, Weihua Chen 외

Image-text retrieval is a central problem for understanding the semantic relationship between vision and language, and serves as the basis for various visual and language tasks. Most previous works either simply learn co…

Image-text RetrievalRepresentation LearningRetrievalText Retrieval

MVCL-DAF++: Enhancing Multimodal Intent Recognition via Prototype-Aware Contrastive Alignment and Coarse-to-Fine Dynamic Attention Fusion

2025-09-22 · Haofeng Huang, Yifei Han, Long Zhang, Bin Li 외 arxiv

Multimodal intent recognition (MMIR) suffers from weak semantic grounding and poor robustness under noisy or rare-class conditions. We propose MVCL-DAF++, which extends MVCL-DAF with two key modules: (1) Prototype-aware …

Multimodal Intent Recognition