paper-with-me

Papers

Deep physical neural networks enabled by a backpropagation algorithm for arbitrary physical systems

2021-04-27 · Logan G. Wright, Tatsuhiro Onodera, Martin M. Stein, Tianyu Wang, Darren T. Schachter, Zoey Hu, Peter L. McMahon

Deep neural networks have become a pervasive tool in science and engineering. However, modern deep neural networks' growing energy requirements now increasingly limit their scaling and broader use. We propose a radical alternative for implementing deep neural network models: Physical Neural Networks. We introduce a hybrid physical-digital algorithm called Physics-Aware Training to efficiently train sequences of controllable physical systems to act as deep neural networks. This method automatically trains the functionality of any sequence of real physical systems, directly, using backpropagation, the same technique used for modern deep neural networks. To illustrate their generality, we demonstrate physical neural networks with three diverse physical systems-optical, mechanical, and electrical. Physical neural networks may facilitate unconventional machine learning hardware that is orders of magnitude faster and more energy efficient than conventional electronic processors.

📄 PDF Abstract BibTeX arXiv:2104.13386

Code (1)

mcmahon-lab/Physics-Aware-Training 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Physical Deep Learning with Biologically Plausible Training Method

2022-04-01 · Mitsumasa Nakajima, Katsuma Inoue, Kenji Tanaka, Yasuo Kuniyoshi 외

The ever-growing demand for further advances in artificial intelligence motivated research on unconventional computation based on analog physical devices. While such computation devices mimic brain-inspired analog inform…

Biologically-plausible TrainingDeep Learning

One-shot backpropagation for multi-step prediction in physics-based system identification -- EXTENDED VERSION

2023-10-31 · Cesare Donati, Martina Mammarella, Fabrizio Dabbene, Carlo Novara 외

The aim of this paper is to present a novel physics-based framework for the identification of dynamical systems, in which the physical and structural insights are reflected directly into a backpropagation-based learning …

Local learning for stable backpropagation-free neural network training towards physical learning

2026-03-25 · Yaqi Guo, Fabian Braun, Bastiaan Ketelaar, Stephanie Tan 외 arxiv

While backpropagation and automatic differentiation have driven deep learning's success, the physical limits of chip manufacturing and rising environmental costs of deep learning motivate alternative learning paradigms s…

Trainable and Dynamic Computing: Error Backpropagation through Physical Media

2014-07-24 · Michiel Hermans, Michaël Burm, Joni Dambre, Peter Bienstman

Machine learning algorithms, and more in particular neural networks, arguably experience a revolution in terms of performance. Currently, the best systems we have for speech recognition, computer vision and similar probl…

speech-recognitionSpeech Recognition

Experimentally realized in situ backpropagation for deep learning in nanophotonic neural networks

2022-05-17 · Sunil Pai, Zhanghao Sun, Tyler W. Hughes, Taewon Park 외

Neural networks are widely deployed models across many scientific disciplines and commercial endeavors ranging from edge computing and sensing to large-scale signal processing in data centers. The most efficient and well…

Edge-computing