paper-with-me

홈 › Papers

Transforming Multimodal Models into Action Models for Radiotherapy

2025-02-06 · Matteo Ferrante, Alessandra Carosi, Rolando Maria D Angelillo, Nicola Toschi

Radiotherapy is a crucial cancer treatment that demands precise planning to balance tumor eradication and preservation of healthy tissue. Traditional treatment planning (TP) is iterative, time-consuming, and reliant on human expertise, which can potentially introduce variability and inefficiency. We propose a novel framework to transform a large multimodal foundation model (MLM) into an action model for TP using a few-shot reinforcement learning (RL) approach. Our method leverages the MLM's extensive pre-existing knowledge of physics, radiation, and anatomy, enhancing it through a few-shot learning process. This allows the model to iteratively improve treatment plans using a Monte Carlo simulator. Our results demonstrate that this method outperforms conventional RL-based approaches in both quality and efficiency, achieving higher reward scores and more optimal dose distributions in simulations on prostate cancer data. This proof-of-concept suggests a promising direction for integrating advanced AI models into clinical workflows, potentially enhancing the speed, quality, and standardization of radiotherapy treatment planning.

📄 PDF Abstract BibTeX arXiv:2502.04408

Code (0)

등록된 구현이 없습니다.

Tasks

AnatomyFew-Shot LearningReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

Weighted Concordance Index Loss-based Multimodal Survival Modeling for Radiation Encephalopathy Assessment in Nasopharyngeal Carcinoma Radiotherapy

2022-06-23 · Jiansheng Fang, Anwei Li, Pu-Yun OuYang, Jiajian Li 외

Radiation encephalopathy (REP) is the most common complication for nasopharyngeal carcinoma (NPC) radiotherapy. It is highly desirable to assist clinicians in optimizing the NPC radiotherapy regimen to reduce radiotherap…

feature selectionSurvival Analysis

Bone marrow sparing for cervical cancer radiotherapy on multimodality medical images

2022-04-20 · Yuening Wang, Ying Sun, Jie Yuan, Kexin Gan 외

Cervical cancer threatens the health of women seriously. Radiotherapy is one of the main therapy methods but with high risk of acute hematologic toxicity. Delineating the bone marrow (BM) for sparing using computer tomog…

Image RegistrationPoint cloud reconstruction

Extracting Relations between Radiotherapy Treatment Details

2020-11-01 · EMNLP (ClinicalNLP) 2020 11 · Danielle Bitterman, Timothy Miller, David Harris, Chen Lin 외

We present work on extraction of radiotherapy treatment information from the clinical narrative in the electronic medical records. Radiotherapy is a central component of the treatment of most solid cancers. Its details a…

RelationRelation Extraction

Longitudinal NSCLC Treatment Progression via Multimodal Generative Models

2026-03-06 · Massimiliano Mantegna, Elena Mulero Ayllón, Alice Natalina Caragliano, Francesco Di Feola 외 arxiv

Predicting tumor evolution during radiotherapy is a clinically critical challenge, particularly when longitudinal changes are driven by both anatomy and treatment. In this work, we introduce a Virtual Treatment (VT) fram…

Image-to-Image Translation

Deep generative model-driven multimodal prostate segmentation in radiotherapy

2019-10-23 · Kibrom Berihu Girum, Gilles Créhange, Raabid Hussain, Paul Michael Walker 외

Deep learning has shown unprecedented success in a variety of applications, such as computer vision and medical image analysis. However, there is still potential to improve segmentation in multimodal images by embedding …

Medical Image AnalysisMulti-Task LearningSegmentation