Communicative Reinforcement Learning Agents for Landmark Detection in Brain Images
Accurate detection of anatomical landmarks is an essential step in several medical imaging tasks. We propose a novel communicative multi-agent reinforcement learning (C-MARL) system to automatically detect landmarks in 3D brain images. C-MARL enables the agents to learn explicit communication channels, as well as implicit communication signals by sharing certain weights of the architecture among all the agents. The proposed approach is evaluated on two brain imaging datasets from adult magnetic resonance imaging (MRI) and fetal ultrasound scans. Our experiments show that involving multiple cooperating agents by learning their communication with each other outperforms previous approaches using single agents.
Code (1)
Tasks
Multi-agent Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
Multiple Landmark Detection using Multi-Agent Reinforcement Learning
The detection of anatomical landmarks is a vital step for medical image analysis and applications for diagnosis, interpretation and guidance. Manual annotation of landmarks is a tedious process that requires domain-speci…
AnatomyMedical Image AnalysisMulti-agent Reinforcement Learningreinforcement-learning+2Enhanced detection of fetal pose in 3D MRI by Deep Reinforcement Learning with physical structure priors on anatomy
Fetal MRI is heavily constrained by unpredictable and substantial fetal motion that causes image artifacts and limits the set of viable diagnostic image contrasts. Current mitigation of motion artifacts is predominantly …
AnatomyDecision MakingDeep Reinforcement LearningDiagnosticIn-Context Reinforcement Learning via Communicative World Models
Reinforcement learning (RL) agents often struggle to generalize to new tasks and contexts without updating their parameters, mainly because their learned representations and policies are overfit to the specifics of their…
Representation LearningReinforcement LearningDual-Agent Deep Reinforcement Learning for Deformable Face Tracking
In this paper, we propose a dual-agent deep reinforcement learning (DADRL) method for deformable face tracking, which generates bounding boxes and detects facial landmarks interactively from face videos. Most existing de…
Deep Reinforcement LearningFacial Landmark Detectionreinforcement-learningReinforcement Learning+1CABLD: Contrast-Agnostic Brain Landmark Detection with Consistency-Based Regularization
Anatomical landmark detection in medical images is essential for various clinical and research applications, including disease diagnosis and surgical planning. However, manual landmark annotation is time-consuming and re…
Anatomical Landmark DetectionBrain landmark detectionImage Registration