paper-with-me

홈 › Papers

Transformer-based Personalized Attention Mechanism for Medical Images with Clinical Records

2022-06-07 · Yusuke Takagi, Noriaki Hashimoto, Hiroki Masuda, Hiroaki Miyoshi, Koichi Ohshima, Hidekata Hontani, Ichiro Takeuchi

In medical image diagnosis, identifying the attention region, i.e., the region of interest for which the diagnosis is made, is an important task. Various methods have been developed to automatically identify target regions from given medical images. However, in actual medical practice, the diagnosis is made based not only on the images but also on a variety of clinical records. This means that pathologists examine medical images with some prior knowledge of the patients and that the attention regions may change depending on the clinical records. In this study, we propose a method called the Personalized Attention Mechanism (PersAM), by which the attention regions in medical images are adaptively changed according to the clinical records. The primary idea of the PersAM method is to encode the relationships between the medical images and clinical records using a variant of Transformer architecture. To demonstrate the effectiveness of the PersAM method, we applied it to a large-scale digital pathology problem of identifying the subtypes of 842 malignant lymphoma patients based on their gigapixel whole slide images and clinical records.

📄 PDF Abstract BibTeX arXiv:2206.03003

Code (1)

persam-mil/persam 공식 구현 pytorch

Tasks

whole slide images

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Adam 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

Multi-dimension Transformer with Attention-based Filtering for Medical Image Segmentation

2024-05-20 · Wentao Wang, Xi Xiao, Mingjie Liu, Qing Tian 외

The accurate segmentation of medical images is crucial for diagnosing and treating diseases. Recent studies demonstrate that vision transformer-based methods have significantly improved performance in medical image segme…

Image SegmentationMedical Image SegmentationSegmentationSemantic Segmentation

Federated Learning for Chronic Obstructive Pulmonary Disease Classification with Partial Personalized Attention Mechanism

2022-10-28 · Yiqing Shen, Baiyun Liu, Ruize Yu, Yudong Wang 외

Chronic Obstructive Pulmonary Disease (COPD) is the fourth leading cause of death worldwide. Yet, COPD diagnosis heavily relies on spirometric examination as well as functional airway limitation, which may cause a consid…

Federated LearningPersonalized Federated Learning

SeUNet-Trans: A Simple yet Effective UNet-Transformer Model for Medical Image Segmentation

2023-10-16 · Tan-Hanh Pham, Xianqi Li, Kim-Doang Nguyen

Automated medical image segmentation is becoming increasingly crucial to modern clinical practice, driven by the growing demand for precise diagnosis, the push towards personalized treatment plans, and the advancements i…

Image SegmentationMedical Image SegmentationSegmentationSemantic Segmentation

Medical Transformer: Gated Axial-Attention for Medical Image Segmentation

2021-02-21 · Jeya Maria Jose Valanarasu, Poojan Oza, Ilker Hacihaliloglu, Vishal M. Patel

Over the past decade, Deep Convolutional Neural Networks have been widely adopted for medical image segmentation and shown to achieve adequate performance. However, due to the inherent inductive biases present in the con…

Image SegmentationMedical Image SegmentationSegmentationSemantic Segmentation

Dynamic Linear Transformer for 3D Biomedical Image Segmentation

2022-06-01 · Zheyuan Zhang, Ulas Bagci

Transformer-based neural networks have surpassed promising performance on many biomedical image segmentation tasks due to a better global information modeling from the self-attention mechanism. However, most methods are …

3D Medical Imaging SegmentationDecoderImage SegmentationMedical Image Segmentation+4