paper-with-me

홈 › Papers

Advancing Medical Imaging with Language Models: A Journey from N-grams to ChatGPT

2023-04-11 · Mingzhe Hu, Shaoyan Pan, Yuheng Li, Xiaofeng Yang

In this paper, we aimed to provide a review and tutorial for researchers in the field of medical imaging using language models to improve their tasks at hand. We began by providing an overview of the history and concepts of language models, with a special focus on large language models. We then reviewed the current literature on how language models are being used to improve medical imaging, emphasizing different applications such as image captioning, report generation, report classification, finding extraction, visual question answering, interpretable diagnosis, and more for various modalities and organs. The ChatGPT was specially highlighted for researchers to explore more potential applications. We covered the potential benefits of accurate and efficient language models for medical imaging analysis, including improving clinical workflow efficiency, reducing diagnostic errors, and assisting healthcare professionals in providing timely and accurate diagnoses. Overall, our goal was to bridge the gap between language models and medical imaging and inspire new ideas and innovations in this exciting area of research. We hope that this review paper will serve as a useful resource for researchers in this field and encourage further exploration of the possibilities of language models in medical imaging.

📄 PDF Abstract BibTeX arXiv:2304.04920

Code (0)

등록된 구현이 없습니다.

Tasks

DiagnosticImage CaptioningQuestion AnsweringVisual Question Answering

Similar Papers 제목 키워드 기반

BiomedJourney: Counterfactual Biomedical Image Generation by Instruction-Learning from Multimodal Patient Journeys

2023-10-16 · Yu Gu, Jianwei Yang, Naoto Usuyama, Chunyuan Li 외

Rapid progress has been made in instruction-learning for image editing with natural-language instruction, as exemplified by InstructPix2Pix. In biomedicine, such methods can be applied to counterfactual image generation,…

counterfactualDenoisingImage GenerationMedical Image Generation

O1 Replication Journey -- Part 3: Inference-time Scaling for Medical Reasoning

2025-01-11 · Zhongzhen Huang, Gui Geng, Shengyi Hua, Zhen Huang 외

Building upon our previous investigations of O1 replication (Part 1: Journey Learning [Qin et al., 2024] and Part 2: Distillation [Huang et al., 2024]), this work explores the potential of inference-time scaling in large…

Decision MakingDiagnosticMedQA

Self-Attention Enhanced Patient Journey Understanding in Healthcare System

2020-06-15 · Xueping Peng, Guodong Long, Tao Shen, Sen Wang 외

Understanding patients' journeys in healthcare system is a fundamental prepositive task for a broad range of AI-based healthcare applications. This task aims to learn an informative representation that can comprehensivel…

Toward a Vision-Language Foundation Model for Medical Data: Multimodal Dataset and Benchmarks for Vietnamese PET/CT Report Generation

2025-09-29 · Huu Tien Nguyen, Dac Thai Nguyen, The Minh Duc Nguyen, Trung Thanh Nguyen 외 arxiv

Vision-Language Foundation Models (VLMs), trained on large-scale multimodal datasets, have driven significant advances in Artificial Intelligence (AI) by enabling rich cross-modal reasoning. Despite their success in gene…

Data Augmentation

Medical Image Fusion: A survey of the state of the art

2013-12-31 · A. P. James, B. V. Dasarathy

Medical image fusion is the process of registering and combining multiple images from single or multiple imaging modalities to improve the imaging quality and reduce randomness and redundancy in order to increase the cli…