DAD vision: opto-electronic co-designed computer vision with division adjoint method
The miniaturization and mobility of computer vision systems are limited by the heavy computational burden and the size of optical lenses. Here, we propose to use a ultra-thin diffractive optical element to implement passive optical convolution. A division adjoint opto-electronic co-design method is also proposed. In our simulation experiments, the first few convolutional layers of the neural network can be replaced by optical convolution in a classification task on the CIFAR-10 dataset with no power consumption, while similar performance can be obtained.
Code (0)
등록된 구현이 없습니다.
Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Analog readout for optical reservoir computers
Reservoir computing is a new, powerful and flexible machine learning technique that is easily implemented in hardware. Recently, by using a time-multiplexed architecture, hardware reservoir computers have reached perform…
Direct Kernel Optimization: Efficient Design for Opto-Electronic Convolutional Neural Networks
Hybrid opto-electronic neural networks combine optical front-ends with electronic back-ends to perform vision tasks, but joint end-to-end (E2E) optimization of optical and electronic components is computationally expensi…
Monocular Depth EstimationIzhikevich-Inspired Optoelectronic Neurons with Excitatory and Inhibitory Inputs for Energy-Efficient Photonic Spiking Neural Networks
We designed, prototyped, and experimentally demonstrated, for the first time to our knowledge, an optoelectronic spiking neuron inspired by the Izhikevich model incorporating both excitatory and inhibitory optical spikin…
Symmetry-Constrained Generation of Diverse Low-Bandgap Molecules with Monte Carlo Tree Search
Organic optoelectronic materials are a promising avenue for next-generation electronic devices due to their solution processability, mechanical flexibility, and tunable electronic properties. In particular, near-infrared…
Identifying and understanding the positive impact of defects and traps for perovskites optoelectronic devices
Abstract: Defects are generally regarded to have negative impact on carrier recombination, charge-transport and ion migration in perovskite materials, which thus lower the efficiency and stability of perovskite optoelect…