paper-with-me

홈 › Papers

Position-prior Clustering-based Self-attention Module for Knee Cartilage Segmentation

2022-06-21 · Dong Liang, Jun Liu, Kuanquan Wang, Gongning Luo, Wei Wang, Shuo Li

The morphological changes in knee cartilage (especially femoral and tibial cartilages) are closely related to the progression of knee osteoarthritis, which is expressed by magnetic resonance (MR) images and assessed on the cartilage segmentation results. Thus, it is necessary to propose an effective automatic cartilage segmentation model for longitudinal research on osteoarthritis. In this research, to relieve the problem of inaccurate discontinuous segmentation caused by the limited receptive field in convolutional neural networks, we proposed a novel position-prior clustering-based self-attention module (PCAM). In PCAM, long-range dependency between each class center and feature point is captured by self-attention allowing contextual information re-allocated to strengthen the relative features and ensure the continuity of segmentation result. The clutsering-based method is used to estimate class centers, which fosters intra-class consistency and further improves the accuracy of segmentation results. The position-prior excludes the false positives from side-output and makes center estimation more precise. Sufficient experiments are conducted on OAI-ZIB dataset. The experimental results show that the segmentation performance of combination of segmentation network and PCAM obtains an evident improvement compared to original model, which proves the potential application of PCAM in medical segmentation tasks. The source code is publicly available from link: https://github.com/LeongDong/PCAMNet

📄 PDF Abstract BibTeX arXiv:2206.10286

Code (1)

leongdong/pcamnet 공식 구현 pytorch

Tasks

ClusteringPositionSegmentation

Similar Papers 제목 키워드 기반

CaEGCN: Cross-Attention Fusion based Enhanced Graph Convolutional Network for Clustering

2021-01-18 · Guangyu Huo, Yong Zhang, Junbin Gao, Boyue Wang 외

With the powerful learning ability of deep convolutional networks, deep clustering methods can extract the most discriminative information from individual data and produce more satisfactory clustering results. However, e…

ClusteringDeep Clustering

Deep Attention-guided Graph Clustering with Dual Self-supervision

2021-11-10 · Zhihao Peng, Hui Liu, Yuheng Jia, Junhui Hou

Existing deep embedding clustering works only consider the deepest layer to learn a feature embedding and thus fail to well utilize the available discriminative information from cluster assignments, resulting performance…

ClusteringDeep AttentionGraph ClusteringTriplet

Interlaced Sparse Self-Attention for Semantic Segmentation

2019-07-29 · Lang Huang, Yuhui Yuan, Jianyuan Guo, Chao Zhang 외

In this paper, we present a so-called interlaced sparse self-attention approach to improve the efficiency of the \emph{self-attention} mechanism for semantic segmentation. The main idea is that we factorize the dense aff…

SegmentationSemantic Segmentation

Attention: Self-Expression Is All You Need

2021-09-29 · Rene Vidal

Transformer models have achieved significant improvements in performance for various learning tasks in natural language processing and computer vision. Much of their success is attributed to the use of attention layers t…

AllClustering

MIMO Self-attentive RNN Beamformer for Multi-speaker Speech Separation

2021-04-17 · Xiyun Li, Yong Xu, Meng Yu, Shi-Xiong Zhang 외

Recently, our proposed recurrent neural network (RNN) based all deep learning minimum variance distortionless response (ADL-MVDR) beamformer method yielded superior performance over the conventional MVDR by replacing the…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition+1