paper-with-me

홈 › Papers

A Spiking Neural Network for Image Segmentation

2021-06-16 · Kinjal Patel, Eric Hunsberger, Sean Batir, Chris Eliasmith

We seek to investigate the scalability of neuromorphic computing for computer vision, with the objective of replicating non-neuromorphic performance on computer vision tasks while reducing power consumption. We convert the deep Artificial Neural Network (ANN) architecture U-Net to a Spiking Neural Network (SNN) architecture using the Nengo framework. Both rate-based and spike-based models are trained and optimized for benchmarking performance and power, using a modified version of the ISBI 2D EM Segmentation dataset consisting of microscope images of cells. We propose a partitioning method to optimize inter-chip communication to improve speed and energy efficiency when deploying multi-chip networks on the Loihi neuromorphic chip. We explore the advantages of regularizing firing rates of Loihi neurons for converting ANN to SNN with minimum accuracy loss and optimized energy consumption. We propose a percentile based regularization loss function to limit the spiking rate of the neuron between a desired range. The SNN is converted directly from the corresponding ANN, and demonstrates similar semantic segmentation as the ANN using the same number of neurons and weights. However, the neuromorphic implementation on the Intel Loihi neuromorphic chip is over 2x more energy-efficient than conventional hardware (CPU, GPU) when running online (one image at a time). These power improvements are achieved without sacrificing the task performance accuracy of the network, and when all weights (Loihi, CPU, and GPU networks) are quantized to 8 bits.

📄 PDF Abstract BibTeX arXiv:2106.08921

Code (0)

등록된 구현이 없습니다.

Tasks

BenchmarkingCPUGPUImage SegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

Concatenated Skip Connection A Concatenated Skip Connection is a type of skip connection that seeks to reuse features by concatenating them to new layers, allowing more information to be retained from…
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
U-Net 설명 없음

Similar Papers 제목 키워드 기반

Spike2Former: Efficient Spiking Transformer for High-performance Image Segmentation

2024-12-19 · Zhenxin Lei, Man Yao, Jiakui Hu, Xinhao Luo 외

Spiking Neural Networks (SNNs) have a low-power advantage but perform poorly in image segmentation tasks. The reason is that directly converting neural networks with complex architectural designs for segmentation tasks i…

Image SegmentationSegmentationSemantic Segmentation

Deep Multi-Threshold Spiking-UNet for Image Processing

2023-07-20 · Hebei Li, Yueyi Zhang, Zhiwei Xiong, Xiaoyan Sun

U-Net, known for its simple yet efficient architecture, is widely utilized for image processing tasks and is particularly suitable for deployment on neuromorphic chips. This paper introduces the novel concept of Spiking-…

DenoisingImage SegmentationSemantic Segmentation

Reliable Brain Tumor Segmentation Based on Spiking Neural Networks with Efficient Training

2026-01-23 · Aurora Pia Ghiardelli, Guangzhi Tang, Tao Sun arxiv

We propose a reliable and energy-efficient framework for 3D brain tumor segmentation using spiking neural networks (SNNs). A multi-view ensemble of sagittal, coronal, and axial SNN models provides voxel-wise uncertainty …

Brain Tumor SegmentationImage Segmentation

Deep Spiking Convolutional Neural Network for Single Object Localization Based On Deep Continuous Local Learning

2021-05-12 · Sami Barchid, José Mennesson, Chaabane Djéraba

With the advent of neuromorphic hardware, spiking neural networks can be a good energy-efficient alternative to artificial neural networks. However, the use of spiking neural networks to perform computer vision tasks rem…

object-detectionObject DetectionObject Localization

Beyond Classification: Directly Training Spiking Neural Networks for Semantic Segmentation

2021-10-14 · Youngeun Kim, Joshua Chough, Priyadarshini Panda

Spiking Neural Networks (SNNs) have recently emerged as the low-power alternative to Artificial Neural Networks (ANNs) because of their sparse, asynchronous, and binary event-driven processing. Due to their energy effici…

Autonomous VehiclesClassificationSegmentationSemantic Segmentation