paper-with-me

홈 › Papers

An optical neural network using less than 1 photon per multiplication

2021-04-27 · Tianyu Wang, Shi-Yuan Ma, Logan G. Wright, Tatsuhiro Onodera, Brian Richard, Peter L. McMahon

Deep learning has rapidly become a widespread tool in both scientific and commercial endeavors. Milestones of deep learning exceeding human performance have been achieved for a growing number of tasks over the past several years, across areas as diverse as game-playing, natural-language translation, and medical-image analysis. However, continued progress is increasingly hampered by the high energy costs associated with training and running deep neural networks on electronic processors. Optical neural networks have attracted attention as an alternative physical platform for deep learning, as it has been theoretically predicted that they can fundamentally achieve higher energy efficiency than neural networks deployed on conventional digital computers. Here, we experimentally demonstrate an optical neural network achieving 99% accuracy on handwritten-digit classification using ~3.2 detected photons per weight multiplication and ~90% accuracy using ~0.64 photons (~$2.4 \times 10^{-19}$ J of optical energy) per weight multiplication. This performance was achieved using a custom free-space optical processor that executes matrix-vector multiplications in a massively parallel fashion, with up to ~0.5 million scalar (weight) multiplications performed at the same time. Using commercially available optical components and standard neural-network training methods, we demonstrated that optical neural networks can operate near the standard quantum limit with extremely low optical powers and still achieve high accuracy. Our results provide a proof-of-principle for low-optical-power operation, and with careful system design including the surrounding electronics used for data storage and control, open up a path to realizing optical processors that require only $10^{-16}$ J total energy per scalar multiplication -- which is orders of magnitude more efficient than current digital processors.

📄 PDF Abstract BibTeX arXiv:2104.13467

Code (2)

mcmahon-lab/ONN-QAT-SQL 공식 구현 pytorch
mcmahon-lab/ONN-device-control 공식 구현 pytorch

Tasks

Medical Image Analysis

Similar Papers 제목 키워드 기반

Data-driven Modeling of Mach-Zehnder Interferometer-based Optical Matrix Multipliers

2022-10-17 · Ali Cem, Siqi Yan, Yunhong Ding, Darko Zibar 외

Photonic integrated circuits are facilitating the development of optical neural networks, which have the potential to be both faster and more energy efficient than their electronic counterparts since optical signals are …

ChatGPT at the Speed of Light: Optical Comb-Based Monolithic Photonic-Electronic Linear-Algebra Accelerators

2023-11-19 · Tzu-Chien Hsueh, Yeshaiahu Fainman, Bill Lin

This paper proposes to adopt advanced monolithic silicon-photonics integrated-circuits manufacturing capabilities to achieve a system-on-chip photonic-electronic linear-algebra accelerator with the features of optical co…

A compact butterfly-style silicon photonic-electronic neural chip for hardware-efficient deep learning

2021-11-11 · Chenghao Feng, Jiaqi Gu, Hanqing Zhu, Zhoufeng Ying 외

The optical neural network (ONN) is a promising hardware platform for next-generation neurocomputing due to its high parallelism, low latency, and low energy consumption. Previous ONN architectures are mainly designed fo…

Toward all-optical unsupervised Hebbian learning in deep photonic neuromorphic networks

2026-01-29 · Xi Li, Disha Biswas, Peng Zhou, Wesley H. Brigner 외 arxiv

We propose a deep photonic neuromorphic network (PNN) architecture based on phase-change material (PCM) synapses and local optical feedback for online, unsupervised Hebbian learning. The proposed architecture combines op…

ELight: Enabling Efficient Photonic In-Memory Neurocomputing with Life Enhancement

2021-12-15 · Hanqing Zhu, Jiaqi Gu, Chenghao Feng, Mingjie Liu 외

With the recent advances in optical phase change material (PCM), photonic in-memory neurocomputing has demonstrated its superiority in optical neural network (ONN) designs with near-zero static power consumption, time-of…