Transformer-based Personalized Attention Mechanism for Medical Images with Clinical Records
In medical image diagnosis, identifying the attention region, i.e., the region of interest for which the diagnosis is made, is an important task. Various methods have been developed to automatically identify target regions from given medical images. However, in actual medical practice, the diagnosis is made based not only on the images but also on a variety of clinical records. This means that pathologists examine medical images with some prior knowledge of the patients and that the attention regions may change depending on the clinical records. In this study, we propose a method called the Personalized Attention Mechanism (PersAM), by which the attention regions in medical images are adaptively changed according to the clinical records. The primary idea of the PersAM method is to encode the relationships between the medical images and clinical records using a variant of Transformer architecture. To demonstrate the effectiveness of the PersAM method, we applied it to a large-scale digital pathology problem of identifying the subtypes of 842 malignant lymphoma patients based on their gigapixel whole slide images and clinical records.
Code (1)
Tasks
whole slide imagesMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Multi-dimension Transformer with Attention-based Filtering for Medical Image Segmentation
The accurate segmentation of medical images is crucial for diagnosing and treating diseases. Recent studies demonstrate that vision transformer-based methods have significantly improved performance in medical image segme…
Image SegmentationMedical Image SegmentationSegmentationSemantic SegmentationFederated Learning for Chronic Obstructive Pulmonary Disease Classification with Partial Personalized Attention Mechanism
Chronic Obstructive Pulmonary Disease (COPD) is the fourth leading cause of death worldwide. Yet, COPD diagnosis heavily relies on spirometric examination as well as functional airway limitation, which may cause a consid…
Federated LearningPersonalized Federated LearningSeUNet-Trans: A Simple yet Effective UNet-Transformer Model for Medical Image Segmentation
Automated medical image segmentation is becoming increasingly crucial to modern clinical practice, driven by the growing demand for precise diagnosis, the push towards personalized treatment plans, and the advancements i…
Image SegmentationMedical Image SegmentationSegmentationSemantic SegmentationMedical Transformer: Gated Axial-Attention for Medical Image Segmentation
Over the past decade, Deep Convolutional Neural Networks have been widely adopted for medical image segmentation and shown to achieve adequate performance. However, due to the inherent inductive biases present in the con…
Image SegmentationMedical Image SegmentationSegmentationSemantic SegmentationDynamic Linear Transformer for 3D Biomedical Image Segmentation
Transformer-based neural networks have surpassed promising performance on many biomedical image segmentation tasks due to a better global information modeling from the self-attention mechanism. However, most methods are …
3D Medical Imaging SegmentationDecoderImage SegmentationMedical Image Segmentation+4