paper-with-me

Papers

On-Device Unsupervised Image Segmentation

2023-02-24 · Junhuan Yang, Yi Sheng, Yuzhou Zhang, Weiwen Jiang, Lei Yang

Along with the breakthrough of convolutional neural networks, learning-based segmentation has emerged in many research works. Most of them are based on supervised learning, requiring plenty of annotated data; however, to support segmentation, a label for each pixel is required, which is obviously expensive. As a result, the issue of lacking annotated segmentation data commonly exists. Continuous learning is a promising way to deal with this issue; however, it still has high demands on human labor for annotation. What's more, privacy is highly required in segmentation data for real-world applications, which further calls for on-device learning. In this paper, we aim to resolve the above issue in an alternative way: Instead of supervised segmentation, we propose to develop efficient unsupervised segmentation that can be executed on edge devices. Based on our observation that segmentation can obtain high performance when pixels are mapped to a high-dimension space, we for the first time bring brain-inspired hyperdimensional computing (HDC) to the segmentation task. We build the HDC-based unsupervised segmentation framework, namely "SegHDC". In SegHDC, we devise a novel encoding approach that follows the Manhattan distance. A clustering algorithm is further developed on top of the encoded high-dimension vectors to obtain segmentation results. Experimental results show SegHDC can significantly surpass neural network-based unsupervised segmentation. On a standard segmentation dataset, DSB2018, SegHDC can achieve a 28.0% improvement in Intersection over Union (IoU) score; meanwhile, it achieves over 300x speedup on Raspberry PI. What's more, for a larger size image in the BBBC005 dataset, the existing approach cannot be accommodated to Raspberry PI due to out of memory; on the other hand, SegHDC can obtain segmentation results within 3 minutes while achieving a 0.9587 IoU score.

📄 PDF Abstract BibTeX arXiv:2303.12753

Code (0)

등록된 구현이 없습니다.

Tasks

Image SegmentationSegmentationSemantic SegmentationUnsupervised Image Segmentation

Similar Papers 제목 키워드 기반

Using CycleGANs for effectively reducing image variability across OCT devices and improving retinal fluid segmentation

2019-01-24 · Philipp Seeböck, David Romo-Bucheli, Sebastian Waldstein, Hrvoje Bogunović 외

Optical coherence tomography (OCT) has become the most important imaging modality in ophthalmology. A substantial amount of research has recently been devoted to the development of machine learning (ML) models for the id…

Q-Seg: Quantum Annealing-Based Unsupervised Image Segmentation

2023-11-21 · Supreeth Mysore Venkatesh, Antonio Macaluso, Marlon Nuske, Matthias Klusch 외

We present Q-Seg, a novel unsupervised image segmentation method based on quantum annealing, tailored for existing quantum hardware. We formulate the pixel-wise segmentation problem, which assimilates spectral and spatia…

Earth ObservationImage SegmentationSegmentationSemantic Segmentation+1

Unsupervised Domain Adaptation with Histogram-gated Image Translation for Delayered IC Image Analysis

2022-09-27 · Yee-Yang Tee, Deruo Cheng, Chye-Soon Chee, Tong Lin 외

Deep learning has achieved great success in the challenging circuit annotation task by employing Convolutional Neural Networks (CNN) for the segmentation of circuit structures. The deep learning approaches require a larg…

Deep LearningDomain AdaptationGenerative Adversarial NetworkSegmentation+2

Towards Unsupervised Eye-Region Segmentation for Eye Tracking

2024-10-08 · Jiangfan Deng, Zhuang Jia, Zhaoxue Wang, Xiang Long 외

Finding the eye and parsing out the parts (e.g. pupil and iris) is a key prerequisite for image-based eye tracking, which has become an indispensable module in today's head-mounted VR/AR devices. However, a typical route…

Noise transfer for unsupervised domain adaptation of retinal OCT images

2022-09-16 · Valentin Koch, Olle Holmberg, Hannah Spitzer, Johannes Schiefelbein 외

Optical coherence tomography (OCT) imaging from different camera devices causes challenging domain shifts and can cause a severe drop in accuracy for machine learning models. In this work, we introduce a minimal noise ad…

Domain AdaptationSemantic SegmentationStyle TransferUnsupervised Domain Adaptation