Gradients of unitary optical neural networks using parameter-shift rule
This paper explores the application of the parameter-shift rule (PSR) for computing gradients in unitary optical neural networks (UONNs). While backpropagation has been fundamental to training conventional neural networks, its implementation in optical neural networks faces significant challenges due to the physical constraints of optical systems. We demonstrate how PSR, which calculates gradients by evaluating functions at shifted parameter values, can be effectively adapted for training UONNs constructed from Mach-Zehnder interferometer meshes. The method leverages the inherent Fourier series nature of optical interference in these systems to compute exact analytical gradients directly from hardware measurements. This approach offers a promising alternative to traditional in silico training methods and circumvents the limitations of both finite difference approximations and all-optical backpropagation implementations. We present the theoretical framework and practical methodology for applying PSR to optimize phase parameters in optical neural networks, potentially advancing the development of efficient hardware-based training strategies for optical computing systems.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Exact gradients for linear optics with single photons
Though parameter shift rules have drastically improved gradient estimation methods for several types of quantum circuits, leading to improved performance in downstream tasks, so far they have not been transferable to lin…
Leveraging machine learning features for linear optical interferometer control
We have developed an algorithm that constructs a model of a reconfigurable optical interferometer, independent of specific architectural constraints. The programming of unitary transformations on the interferometer's opt…
Optical Phase Dropout in Diffractive Deep Neural Network
Unitary learning is a backpropagation that serves to unitary weights update in deep complex-valued neural network with full connections, meeting a physical unitary prior in diffractive deep neural network ([DN]2). Howeve…
Standalone gradient measurement of matrix norm for programmable unitary converters
Programmable unitary converters are powerful tools for realizing unitary transformations, advancing fields of computing and communication. The accuracy of these unitary transformations is crucial for maintaining high fid…
Deep, complex, invertible networks for inversion of transmission effects in multimode optical fibres
We use complex-weighted, deep networks to invert the effects of multimode optical fibre distortion of a coherent input image. We generated experimental data based on collections of optical fibre responses to greyscale in…