paper-with-me

Papers

Synaptic Sampling of Neural Networks

2023-11-21 · James B. Aimone, William Severa, J. Darby Smith

Probabilistic artificial neural networks offer intriguing prospects for enabling the uncertainty of artificial intelligence methods to be described explicitly in their function; however, the development of techniques that quantify uncertainty by well-understood methods such as Monte Carlo sampling has been limited by the high costs of stochastic sampling on deterministic computing hardware. Emerging computing systems that are amenable to hardware-level probabilistic computing, such as those that leverage stochastic devices, may make probabilistic neural networks more feasible in the not-too-distant future. This paper describes the scANN technique -- \textit{sampling (by coinflips) artificial neural networks} -- which enables neural networks to be sampled directly by treating the weights as Bernoulli coin flips. This method is natively well suited for probabilistic computing techniques that focus on tunable stochastic devices, nearly matches fully deterministic performance while also describing the uncertainty of correct and incorrect neural network outputs.

📄 PDF Abstract BibTeX arXiv:2311.13038

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Memristor-based Synaptic Sampling Machines

2018-08-02 · Irina Dolzhikova, Khaled Salama, Vipin Kizheppatt, Alex Pappachen James

Synaptic Sampling Machine (SSM) is a type of neural network model that considers biological unreliability of the synapses. We propose the circuit design of the SSM neural network which is realized through the memristive-…

Edge-computing

Stochastic Synapses Enable Efficient Brain-Inspired Learning Machines

2015-11-14 · Emre O. Neftci, Bruno U. Pedroni, Siddharth Joshi, Maruan Al-Shedivat 외

Recent studies have shown that synaptic unreliability is a robust and sufficient mechanism for inducing the stochasticity observed in cortex. Here, we introduce Synaptic Sampling Machines, a class of neural network model…

Synaptic sampling: A connection between PSP variability and uncertainty explains neurophysiological observations

2015-07-12

When an action potential is transmitted to a postsynaptic neuron, a small change in the postsynaptic neuron's membrane potential occurs. These small changes, known as a postsynaptic potentials (PSPs), are highly variable…

Decision Making

Synaptic Sampling: A Bayesian Approach to Neural Network Plasticity and Rewiring

2015-12-01 · NeurIPS 2015 12 · David Kappel, Stefan Habenschuss, Robert Legenstein, Wolfgang Maass

We reexamine in this article the conceptual and mathematical framework for understanding the organization of plasticity in spiking neural networks. We propose that inherent stochasticity enables synaptic plasticity to ca…

Efficient Sampling-Based Bayesian Active Learning for synaptic characterization

2022-01-19 · Camille Gontier, Simone Carlo Surace, Igor Delvendahl, Martin Müller 외

Bayesian Active Learning (BAL) is an efficient framework for learning the parameters of a model, in which input stimuli are selected to maximize the mutual information between the observations and the unknown parameters.…

Active Learning