paper-with-me

Papers

SkinFormer: Learning Statistical Texture Representation with Transformer for Skin Lesion Segmentation

2024-09-13 · Rongtao Xu, Changwei Wang, Jiguang Zhang, Shibiao Xu, Weiliang Meng, Xiaopeng Zhang

Accurate skin lesion segmentation from dermoscopic images is of great importance for skin cancer diagnosis. However, automatic segmentation of melanoma remains a challenging task because it is difficult to incorporate useful texture representations into the learning process. Texture representations are not only related to the local structural information learned by CNN, but also include the global statistical texture information of the input image. In this paper, we propose a trans\textbf{Former} network (\textbf{SkinFormer}) that efficiently extracts and fuses statistical texture representation for \textbf{Skin} lesion segmentation. Specifically, to quantify the statistical texture of input features, a Kurtosis-guided Statistical Counting Operator is designed. We propose Statistical Texture Fusion Transformer and Statistical Texture Enhance Transformer with the help of Kurtosis-guided Statistical Counting Operator by utilizing the transformer's global attention mechanism. The former fuses structural texture information and statistical texture information, and the latter enhances the statistical texture of multi-scale features. {Extensive experiments on three publicly available skin lesion datasets validate that our SkinFormer outperforms other SOAT methods, and our method achieves 93.2\% Dice score on ISIC 2018. It can be easy to extend SkinFormer to segment 3D images in the future.} Our code is available at https://github.com/Rongtao-Xu/SkinFormer.

📄 PDF Abstract BibTeX arXiv:2409.08652

Code (1)

rongtao-xu/skinformer 공식 구현 pytorch

Tasks

Lesion SegmentationSegmentationSkin Lesion Segmentation

Methods 이 논문이 사용한 방법론

Attention 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Position-Wise Feed-Forward Layer 설명 없음

Similar Papers 제목 키워드 기반

Chebyshev Attention Depth Permutation Texture Network with Latent Texture Attribute Loss

2025-01-01 · CVPR 2025 1 · Ravishankar Evani, Deepu Rajan, Shangbo Mao

Despite recent advances in deep texture recognition, existing methods still lack representational diversity and struggle to capture and preserve discriminative cues across stages of representation hierarchies. Moreov…

AttributeMaterial Recognition

Skin Texture Recognition Using Neural Networks

2013-11-23 · Nidhal K. El Abbadi, Nazar Dahir, Zaid Abd Alkareem

Skin recognition is used in many applications ranging from algorithms for face detection, hand gesture analysis, and to objectionable image filtering. In this work a skin recognition system was developed and tested. Whil…

Face Detection

Evaluating The Robustness of Self-Supervised Representations to Background/Foreground Removal

2023-06-02 · Xavier F. Cadet, Ranya Aloufi, Alain Miranville, Sara Ahmadi-Abhari 외

Despite impressive empirical advances of SSL in solving various tasks, the problem of understanding and characterizing SSL representations learned from input data remains relatively under-explored. We provide a comparati…

image-classificationImage Classification

Representation Learning for Wearable-Based Applications in the Case of Missing Data

2024-01-08 · Janosch Jungo, Yutong Xiang, Shkurta Gashi, Christian Holz

Wearable devices continuously collect sensor data and use it to infer an individual's behavior, such as sleep, physical activity, and emotions. Despite the significant interest and advancements in this field, modeling mu…

ImputationRepresentation LearningSelf-Supervised Learning

Transformer-Based Auxiliary Loss for Face Recognition Across Age Variations

2024-12-03 · Pritesh Prakash, Ashish Jacob Sam, S Umamaheswaran

Aging presents a significant challenge in face recognition, as changes in skin texture and tone can alter facial features over time, making it particularly difficult to compare images of the same individual taken years a…

Face Recognition