paper-with-me

Papers

GIT-CXR: End-to-End Transformer for Chest X-Ray Report Generation

2025-01-05 · Iustin Sîrbu, Iulia-Renata Sîrbu, Jasmina Bogojeska, Traian Rebedea

Medical imaging is crucial for diagnosing, monitoring, and treating medical conditions. The medical reports of radiology images are the primary medium through which medical professionals attest their findings, but their writing is time consuming and requires specialized clinical expertise. The automated generation of radiography reports has thus the potential to improve and standardize patient care and significantly reduce clinicians workload. Through our work, we have designed and evaluated an end-to-end transformer-based method to generate accurate and factually complete radiology reports for X-ray images. Additionally, we are the first to introduce curriculum learning for end-to-end transformers in medical imaging and demonstrate its impact in obtaining improved performance. The experiments have been conducted using the MIMIC-CXR-JPG database, the largest available chest X-ray dataset. The results obtained are comparable with the current state-of-the-art on the natural language generation (NLG) metrics BLEU and ROUGE-L, while setting new state-of-the-art results on F1 examples-averaged, F1-macro and F1-micro metrics for clinical accuracy and on the METEOR metric widely used for NLG.

📄 PDF Abstract BibTeX arXiv:2501.02598

Code (0)

등록된 구현이 없습니다.

Tasks

Text Generation

Similar Papers 제목 키워드 기반

Chest-Diffusion: A Light-Weight Text-to-Image Model for Report-to-CXR Generation

2024-06-30 · Peng Huang, Xue Gao, Lihong Huang, Jing Jiao 외

Text-to-image generation has important implications for generation of diverse and controllable images. Several attempts have been made to adapt Stable Diffusion (SD) to the medical domain. However, the large distribution…

DenoisingImage GenerationText to Image GenerationText-to-Image Generation

Vision-Language Models for Automated Chest X-ray Interpretation: Leveraging ViT and GPT-2

2025-01-21 · Md. Rakibul Islam, Md. Zahid Hossain, Mustofa Ahmed, Most. Sharmin Sultana Samu

Radiology plays a pivotal role in modern medicine due to its non-invasive diagnostic capabilities. However, the manual generation of unstructured medical reports is time consuming and prone to errors. It creates a signif…

Diagnostic

RATCHET: Medical Transformer for Chest X-ray Diagnosis and Reporting

2021-07-05 · Benjamin Hou, Georgios Kaissis, Ronald Summers, Bernhard Kainz

Chest radiographs are one of the most common diagnostic modalities in clinical routine. It can be done cheaply, requires minimal equipment, and the image can be diagnosed by every radiologists. However, the number of che…

DiagnosticText Generation

Improving Chest X-Ray Report Generation by Leveraging Warm Starting

2022-01-24 · Aaron Nicolson, Jason Dowling, Bevan Koopman

Automatically generating a report from a patient's Chest X-Rays (CXRs) is a promising solution to reducing clinical workload and improving patient care. However, current CXR report generators -- which are predominantly e…

DecoderDiagnosticText Generation

Clinical Context-aware Radiology Report Generation from Medical Images using Transformers

2024-08-21 · Sonit Singh

Recent developments in the field of Natural Language Processing, especially language models such as the transformer have brought state-of-the-art results in language understanding and language generation. In this work, w…

DecoderDiagnosticText Generation