paper-with-me

홈 › Papers

Patient-Specific Deep Reinforcement Learning for Automatic Replanning in Head-and-Neck Cancer Proton Therapy

2025-06-11 · Malvern Madondo, Yuan Shao, Yingzi Liu, Jun Zhou, Xiaofeng Yang, Zhen Tian

Anatomical changes during intensity-modulated proton therapy (IMPT) for head-and-neck cancer (HNC) can shift Bragg peaks, risking tumor underdosing and organ-at-risk overdosing. As a result, treatment replanning is often required to maintain clinically acceptable treatment quality. However, current manual replanning processes are resource-intensive and time-consuming. We propose a patient-specific deep reinforcement learning (DRL) framework for automated IMPT replanning, with a reward-shaping mechanism based on a $150$-point plan quality score addressing competing clinical objectives. We formulate the planning process as an RL problem where agents learn control policies to adjust optimization priorities, maximizing plan quality. Unlike population-based approaches, our framework trains personalized agents for each patient using their planning CT (Computed Tomography) and augmented anatomies simulating anatomical changes (tumor progression and regression). This patient-specific approach leverages anatomical similarities throughout treatment, enabling effective plan adaptation. We implemented two DRL algorithms, Deep Q-Network and Proximal Policy Optimization, using dose-volume histograms (DVHs) as state representations and a $22$-dimensional action space of priority adjustments. Evaluation on five HNC patients using actual replanning CT data showed both DRL agents improved initial plan scores from $120.63 \pm 21.40$ to $139.78 \pm 6.84$ (DQN) and $142.74 \pm 5.16$ (PPO), surpassing manual replans generated by a human planner ($137.20 \pm 5.58$). Clinical validation confirms that improvements translate to better tumor coverage and OAR sparing across diverse anatomical changes. This work demonstrates DRL's potential in addressing geometric and dosimetric complexities of adaptive proton therapy, offering efficient offline adaptation solutions and advancing online adaptive proton therapy.

📄 PDF Abstract BibTeX arXiv:2506.10073

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learning

Similar Papers 제목 키워드 기반

Continue or Replan? Bernoulli-Continuation Policy Learning for Adaptive Horizon Execution

2026-08-04 · Weichen Xu, Zhenhua Liu, Lin Luo, Yaobo Liang 외 arxiv

Existing chunk-based Vision-Language-Action (VLA) models execute a fixed number of actions (i.e., execution horizon) before replanning, turning replanning into a task-agnostic periodic schedule that is independent of tas…

Reinforcement Learning

Dynamic Obstacle Avoidance through Uncertainty-Based Adaptive Planning with Diffusion

2024-09-25 · Vineet Punyamoorty, Pascal Jutras-Dubé, Ruqi Zhang, Vaneet Aggarwal 외

By framing reinforcement learning as a sequence modeling problem, recent work has enabled the use of generative models, such as diffusion models, for planning. While these models are effective in predicting long-horizon …

Collision AvoidanceDecision MakingNavigate

Anticipatory Digital Twins for Online Head-and-Neck Adaptive Proton Therapy via Foundation-Model Registration

2026-08-01 · Yizhou Wu, Yuheng Li, Xiaofeng Yang, Chih-Wei Chang arxiv

Head-and-neck (HN) proton therapy is highly sensitive to anatomical change over a 4-to-6-week course, as tumor shrinkage, weight loss, and setup variation can misposition the Bragg peak near critical organs such as the p…

Adaptive Interactive Navigation of Quadruped Robots using Large Language Models

2025-03-29 · Kangjie Zhou, Yao Mu, Haoyang Song, Yi Zeng 외

Robotic navigation in complex environments remains a critical research challenge. Traditional navigation methods focus on optimal trajectory generation within free space, struggling in environments lacking viable paths t…

Motion PlanningTask Planning

Deep Reinforcement Learning with Dynamic Graphs for Adaptive Informative Path Planning

2024-02-07 · Apoorva Vashisth, Julius Rückin, Federico Magistri, Cyrill Stachniss 외

Autonomous robots are often employed for data collection due to their efficiency and low labour costs. A key task in robotic data acquisition is planning paths through an initially unknown environment to collect observat…

Deep Reinforcement Learningreinforcement-learningvalid