Multi-environment lifelong deep reinforcement learning for medical imaging

2023-05-31 · Guangyao Zheng, Shuhao Lai, Vladimir Braverman, Michael A. Jacobs, Vishwa S. Parekh

Deep reinforcement learning(DRL) is increasingly being explored in medical imaging. However, the environments for medical imaging tasks are constantly evolving in terms of imaging orientations, imaging sequences, and pathologies. To that end, we developed a Lifelong DRL framework, SERIL to continually learn new tasks in changing imaging environments without catastrophic forgetting. SERIL was developed using selective experience replay based lifelong learning technique for the localization of five anatomical landmarks in brain MRI on a sequence of twenty-four different imaging environments. The performance of SERIL, when compared to two baseline setups: MERT(multi-environment-best-case) and SERT(single-environment-worst-case) demonstrated excellent performance with an average distance of $9.90\pm7.35$ pixels from the desired landmark across all 120 tasks, compared to $10.29\pm9.07$ for MERT and $36.37\pm22.41$ for SERT($p<0.05$), demonstrating the excellent potential for continuously learning multiple tasks across dynamically changing imaging environments.

📄 PDF Abstract BibTeX arXiv:2306.00188

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningLifelong learningreinforcement-learning Reinforcement Learning

Methods 이 논문이 사용한 방법론

Experience Replay Experience Replay is a replay memory technique used in reinforcement learning where we store the agent’s experiences at each time-step, $e\_{t} = \left(s\_{t}, a\_{t}, r\_{t},…

A framework for dynamically training and adapting deep reinforcement learning models to different, low-compute, and continuously changing radiology deployment environments

2023-06-08 · Guangyao Zheng, Shuhao Lai, Vladimir Braverman, Michael A. Jacobs 외

While Deep Reinforcement Learning has been widely researched in medical imaging, the training and deployment of these models usually require powerful GPUs. Since imaging environments evolve rapidly and can be generated b…

Deep Reinforcement Learning Lifelong learning reinforcement-learning Reinforcement Learning

Selective experience replay compression using coresets for lifelong deep reinforcement learning in medical imaging

2023-02-22 · Guangyao Zheng, Samson Zhou, Vladimir Braverman, Michael A. Jacobs 외

Selective experience replay is a popular strategy for integrating lifelong learning with deep reinforcement learning. Selective experience replay aims to recount selected experiences from previous tasks to avoid catastro…

Brain Tumor Segmentation Deep Reinforcement Learning Lifelong learning Tumor Segmentation

Some Insights into Lifelong Reinforcement Learning Systems

2020-01-27 · Changjian Li

A lifelong reinforcement learning system is a learning system that has the ability to learn through trail-and-error interaction with the environment over its lifetime. In this paper, I give some arguments to show that th…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

System Design for an Integrated Lifelong Reinforcement Learning Agent for Real-Time Strategy Games

2022-12-08 · Indranil Sur, Zachary Daniels, Abrar Rahman, Kamil Faber 외

As Artificial and Robotic Systems are increasingly deployed and relied upon for real-world applications, it is important that they exhibit the ability to continually learn and adapt in dynamically-changing environments, …

Continual Learning Lifelong learning Real-Time Strategy Games reinforcement-learning+2

Continual Reinforcement Learning with TELLA

2022-08-08 · Neil Fendley, Cash Costello, Eric Nguyen, Gino Perrotta 외

Training reinforcement learning agents that continually learn across multiple environments is a challenging problem. This is made more difficult by a lack of reproducible experiments and standard metrics for comparing di…

Continual Learning Lifelong learning reinforcement-learning Reinforcement Learning+1