Simulating Realistic MRI variations to Improve Deep Learning model and visual explanations using GradCAM
In the medical field, landmark detection in MRI plays an important role in reducing medical technician efforts in tasks like scan planning, image registration, etc. First, 88 landmarks spread across the brain anatomy in the three respective views -- sagittal, coronal, and axial are manually annotated, later guidelines from the expert clinical technicians are taken sub-anatomy-wise, for better localization of the existing landmarks, in order to identify and locate the important atlas landmarks even in oblique scans. To overcome limited data availability, we implement realistic data augmentation to generate synthetic 3D volumetric data. We use a modified HighRes3DNet model for solving brain MRI volumetric landmark detection problem. In order to visually explain our trained model on unseen data, and discern a stronger model from a weaker model, we implement Gradient-weighted Class Activation Mapping (Grad-CAM) which produces a coarse localization map highlighting the regions the model is focusing. Our experiments show that the proposed method shows favorable results, and the overall pipeline can be extended to a variable number of landmarks and other anatomies.
Code (1)
Tasks
AnatomyBrain landmark detectionData AugmentationImage RegistrationSimilar Papers 제목 키워드 기반
Clarity: an improved gradient method for producing quality visual counterfactual explanations
Visual counterfactual explanations identify modifications to an image that would change the prediction of a classifier. We propose a set of techniques based on generative models (VAE) and a classifier ensemble directly t…
counterfactualDiffusion Visual Counterfactual Explanations
Visual Counterfactual Explanations (VCEs) are an important tool to understand the decisions of an image classifier. They are 'small' but 'realistic' semantic changes of the image changing the classifier decision. Current…
counterfactualimage-classificationImage ClassificationViGText: Deepfake Image Detection with Vision-Language Model Explanations and Graph Neural Networks
The rapid rise of deepfake technology, which produces realistic but fraudulent digital content, threatens the authenticity of media. Traditional deepfake detection approaches often struggle with sophisticated, customized…
DeepFake DetectionTowards Safer Online Spaces: Simulating and Assessing Intervention Strategies for Eating Disorder Discussions
Eating disorders are complex mental health conditions that affect millions of people around the world. Effective interventions on social media platforms are crucial, yet testing strategies in situ can be risky. We presen…
Model SelectionA 1D-0D-3D coupled model for simulating blood flow and transport processes in breast tissue
In this work, we present mixed dimensional models for simulating blood flow and transport processes in breast tissue and the vascular tree supplying it. These processes are considered, to start from the aortic inlet to t…