paper-with-me

Papers

Fully Spiking Denoising Diffusion Implicit Models

2023-12-04 · Ryo Watanabe, Yusuke Mukuta, Tatsuya Harada

Spiking neural networks (SNNs) have garnered considerable attention owing to their ability to run on neuromorphic devices with super-high speeds and remarkable energy efficiencies. SNNs can be used in conventional neural network-based time- and energy-consuming applications. However, research on generative models within SNNs remains limited, despite their advantages. In particular, diffusion models are a powerful class of generative models, whose image generation quality surpass that of the other generative models, such as GANs. However, diffusion models are characterized by high computational costs and long inference times owing to their iterative denoising feature. Therefore, we propose a novel approach fully spiking denoising diffusion implicit model (FSDDIM) to construct a diffusion model within SNNs and leverage the high speed and low energy consumption features of SNNs via synaptic current learning (SCL). SCL fills the gap in that diffusion models use a neural network to estimate real-valued parameters of a predefined probabilistic distribution, whereas SNNs output binary spike trains. The SCL enables us to complete the entire generative process of diffusion models exclusively using SNNs. We demonstrate that the proposed method outperforms the state-of-the-art fully spiking generative model.

📄 PDF Abstract BibTeX arXiv:2312.01742

Code (1)

mil-tokyo/FSDDIM 공식 구현 pytorch

Tasks

DenoisingImage Generation

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Spiking Denoising Diffusion Probabilistic Models

2023-06-29 · Jiahang Cao, Ziqing Wang, Hanzhong Guo, Hao Cheng 외

Spiking neural networks (SNNs) have ultra-low energy consumption and high biological plausibility due to their binary and bio-driven nature compared with artificial neural networks (ANNs). While previous research has pri…

Denoising

An attempt to generate new bridge types from latent space of denoising diffusion Implicit model

2024-02-11 · Hongjun Zhang

Use denoising diffusion implicit model for bridge-type innovation. The process of adding noise and denoising to an image can be likened to the process of a corpse rotting and a detective restoring the scene of a victim b…

Denoising

DS2TA: Denoising Spiking Transformer with Attenuated Spatiotemporal Attention

2024-09-20 · Boxun Xu, Hejia Geng, Yuxuan Yin, Peng Li

Vision Transformers (ViT) are current high-performance models of choice for various vision applications. Recent developments have given rise to biologically inspired spiking transformers that thrive in ultra-low power op…

Denoising

Empirical Bayesian image restoration by Langevin sampling with a denoising diffusion implicit prior

2024-09-06 · Charlesquin Kemajou Mbakam, Jean-Francois Giovannelli, Marcelo Pereyra

Score-based diffusion methods provide a powerful strategy to solve image restoration tasks by flexibly combining a pre-trained foundational prior model with a likelihood function specified during test time. Such methods …

DeblurringDenoisingImage DeblurringImage Restoration+1

Denoising Diffusion Implicit Models

2020-10-06 · ICLR 2021 1 · Jiaming Song, Chenlin Meng, Stefano Ermon

Denoising diffusion probabilistic models (DDPMs) have achieved high quality image generation without adversarial training, yet they require simulating a Markov chain for many steps to produce a sample. To accelerate samp…

DenoisingImage Generation