UnSeGArmaNet: Unsupervised Image Segmentation using Graph Neural Networks with Convolutional ARMA Filters
The data-hungry approach of supervised classification drives the interest of the researchers toward unsupervised approaches, especially for problems such as medical image segmentation, where labeled data are difficult to get. Motivated by the recent success of Vision transformers (ViT) in various computer vision tasks, we propose an unsupervised segmentation framework with a pre-trained ViT. Moreover, by harnessing the graph structure inherent within the image, the proposed method achieves a notable performance in segmentation, especially in medical images. We further introduce a modularity-based loss function coupled with an Auto-Regressive Moving Average (ARMA) filter to capture the inherent graph topology within the image. Finally, we observe that employing Scaled Exponential Linear Unit (SELU) and SILU (Swish) activation functions within the proposed Graph Neural Network (GNN) architecture enhances the performance of segmentation. The proposed method provides state-of-the-art performance (even comparable to supervised methods) on benchmark image segmentation datasets such as ECSSD, DUTS, and CUB, as well as challenging medical image segmentation datasets such as KVASIR, CVC-ClinicDB, ISIC-2018. The github repository of the code is available on \url{https://github.com/ksgr5566/UnSeGArmaNet}.
Code (1)
Tasks
Graph Neural NetworkImage SegmentationMedical Image SegmentationSegmentationSemantic SegmentationUnsupervised Image SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Patch-Based Deep Unsupervised Image Segmentation using Graph Cuts
Unsupervised image segmentation aims at grouping different semantic patterns in an image without the use of human annotation. Similarly, image clustering searches for groupings of images based on their semantic content w…
ClusteringDeep ClusteringImage ClusteringImage Segmentation+3Medical Image Segmentation via Unsupervised Convolutional Neural Network
For the majority of the learning-based segmentation methods, a large quantity of high-quality training data is required. In this paper, we present a novel learning-based segmentation model that could be trained semi- or …
Image SegmentationMedical Image SegmentationSegmentationSemantic SegmentationUnsupervised segmentation of irradiation$\unicode{x2010}$induced order$\unicode{x2010}$disorder phase transitions in electron microscopy
We present a method for the unsupervised segmentation of electron microscopy images, which are powerful descriptors of materials and chemical systems. Images are oversegmented into overlapping chips, and similarity graph…
Community DetectionSegmentationUnsupervised Segmentation of 3D Medical Images Based on Clustering and Deep Representation Learning
This paper presents a novel unsupervised segmentation method for 3D medical images. Convolutional neural networks (CNNs) have brought significant advances in image segmentation. However, most of the recent methods rely o…
ClusteringImage SegmentationMedical Image SegmentationRepresentation Learning+2Variational multichannel multiclass segmentation using unsupervised lifting with CNNs
We propose an unsupervised image segmentation approach, that combines a variational energy functional and deep convolutional neural networks. The variational part is based on a recent multichannel multiphase Chan-Vese mo…
Image SegmentationSegmentationSemantic SegmentationUnsupervised Image Segmentation