paper-with-me

Papers

Towards Interpretable Radiology Report Generation via Concept Bottlenecks using a Multi-Agentic RAG

2024-12-20 · Hasan Md Tusfiqur Alam, Devansh Srivastav, Md Abdul Kadir, Daniel Sonntag

Deep learning has advanced medical image classification, but interpretability challenges hinder its clinical adoption. This study enhances interpretability in Chest X-ray (CXR) classification by using concept bottleneck models (CBMs) and a multi-agent Retrieval-Augmented Generation (RAG) system for report generation. By modeling relationships between visual features and clinical concepts, we create interpretable concept vectors that guide a multi-agent RAG system to generate radiology reports, enhancing clinical relevance, explainability, and transparency. Evaluation of the generated reports using an LLM-as-a-judge confirmed the interpretability and clinical utility of our model's outputs. On the COVID-QU dataset, our model achieved 81% classification accuracy and demonstrated robust report generation performance, with five key metrics ranging between 84% and 90%. This interpretable multi-agent framework bridges the gap between high-performance AI and the explainability required for reliable AI-driven CXR analysis in clinical settings. Our code is available at https://github.com/tifat58/IRR-with-CBM-RAG.git.

📄 PDF Abstract BibTeX arXiv:2412.16086

Code (1)

tifat58/irr-with-cbm-rag 공식 구현 pytorch

Tasks

Classificationimage-classificationImage ClassificationMedical Image ClassificationRAGRetrieval-augmented Generation

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음
Adam 설명 없음
Weight Decay 설명 없음
Multi-Head Attention 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

CBM-RAG: Demonstrating Enhanced Interpretability in Radiology Report Generation with Multi-Agent RAG and Concept Bottleneck Models

2025-04-29 · Hasan Md Tusfiqur Alam, Devansh Srivastav, Abdulrahman Mohamed Selim, Md Abdul Kadir 외

Advancements in generative Artificial Intelligence (AI) hold great promise for automating radiology workflows, yet challenges in interpretability and reliability hinder clinical adoption. This paper presents an automated…

DiagnosticRAGRetrieval-augmented Generation

Concept-Enhanced Multimodal RAG: Towards Interpretable and Accurate Radiology Report Generation

2026-02-17 · Marco Salmè, Federico Siciliano, Fabrizio Silvestri, Paolo Soda 외 arxiv

Radiology Report Generation (RRG) through Vision-Language Models (VLMs) promises to reduce documentation burden, improve reporting consistency, and accelerate clinical workflows. However, their clinical adoption remains …

An X-Ray Is Worth 15 Features: Sparse Autoencoders for Interpretable Radiology Report Generation

2024-10-04 · Ahmed Abdulaal, Hugo Fry, Nina Montaña-Brown, Ayodeji Ijishakin 외

Radiological services are experiencing unprecedented demand, leading to increased interest in automating radiology report generation. Existing Vision-Language Models (VLMs) suffer from hallucinations, lack interpretabili…

Language ModellingMultimodal Reasoning

MCA-RG: Enhancing LLMs with Medical Concept Alignment for Radiology Report Generation

2025-07-09 · Qilong Xing, Zikai Song, Youjia Zhang, Na Feng 외 arxiv

Despite significant advancements in adapting Large Language Models (LLMs) for radiology report generation (RRG), clinical adoption remains challenging due to difficulties in accurately mapping pathological and anatomical…

Contrastive Learning

Quality Control for Radiology Report Generation Models via Auxiliary Auditing Components

2024-07-31

Automation of medical image interpretation could alleviate bottlenecks in diagnostic workflows, and has become of particular interest in recent years due to advancements in natural language processing. Great strides have…