paper-with-me

Papers

Transformer-based Annotation Bias-aware Medical Image Segmentation

2023-06-02 · Zehui Liao, Yutong Xie, Shishuai Hu, Yong Xia

Manual medical image segmentation is subjective and suffers from annotator-related bias, which can be mimicked or amplified by deep learning methods. Recently, researchers have suggested that such bias is the combination of the annotator preference and stochastic error, which are modeled by convolution blocks located after decoder and pixel-wise independent Gaussian distribution, respectively. It is unlikely that convolution blocks can effectively model the varying degrees of preference at the full resolution level. Additionally, the independent pixel-wise Gaussian distribution disregards pixel correlations, leading to a discontinuous boundary. This paper proposes a Transformer-based Annotation Bias-aware (TAB) medical image segmentation model, which tackles the annotator-related bias via modeling annotator preference and stochastic errors. TAB employs the Transformer with learnable queries to extract the different preference-focused features. This enables TAB to produce segmentation with various preferences simultaneously using a single segmentation head. Moreover, TAB takes the multivariant normal distribution assumption that models pixel correlations, and learns the annotation distribution to disentangle the stochastic error. We evaluated our TAB on an OD/OC segmentation benchmark annotated by six annotators. Our results suggest that TAB outperforms existing medical image segmentation models which take into account the annotator-related bias.

📄 PDF Abstract BibTeX arXiv:2306.01340

Code (1)

Merrical/TAB 공식 구현 pytorch

Tasks

DecoderImage SegmentationMedical Image SegmentationSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Position-Wise Feed-Forward Layer 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

Correlation-aware Coarse-to-fine MLPs for Deformable Medical Image Registration

2024-05-31 · CVPR 2024 1 · Mingyuan Meng, Dagan Feng, Lei Bi, Jinman Kim

Deformable image registration is a fundamental step for medical image analysis. Recently, transformers have been used for registration and outperformed Convolutional Neural Networks (CNNs). Transformers can capture long-…

Deformable Medical Image RegistrationImage RegistrationInductive BiasMedical Image Analysis+1

Modeling Annotator Preference and Stochastic Annotation Error for Medical Image Segmentation

2021-11-26 · Zehui Liao, Shishuai Hu, Yutong Xie, Yong Xia

Manual annotation of medical images is highly subjective, leading to inevitable and huge annotation biases. Deep learning models may surpass human performance on a variety of tasks, but they may also mimic or amplify the…

Image SegmentationMedical Image SegmentationSegmentationSemantic Segmentation

Augmenting Chest X-ray Datasets with Non-Expert Annotations

2023-09-05 · Veronika Cheplygina, Cathrine Damgaard, Trine Naja Eriksen, Dovile Juodelyte 외

The advancement of machine learning algorithms in medical image analysis requires the expansion of training datasets. A popular and cost-effective approach is automated annotation extraction from free-text medical report…

DiagnosticMedical Image Analysis

Enhancing Weakly Supervised 3D Medical Image Segmentation through Probabilistic-aware Learning

2024-03-05 · Runmin Jiang, Zhaoxin Fan, Junhao Wu, Lenghan Zhu 외

3D medical image segmentation is a challenging task with crucial implications for disease diagnosis and treatment planning. Recent advances in deep learning have significantly enhanced fully supervised medical image segm…

Image SegmentationMedical Image SegmentationPseudo LabelSegmentation+2

Domain Aware Multi-Task Pretraining of 3D Swin Transformer for T1-weighted Brain MRI

2024-10-01 · Jonghun Kim, Mansu Kim, HyunJin Park

The scarcity of annotated medical images is a major bottleneck in developing learning models for medical image analysis. Hence, recent studies have focused on pretrained models with fewer annotation requirements that can…

AnatomyContrastive LearningMedical Image AnalysisMulti-Task Learning