paper-with-me

홈 › Papers

Physics-aware Roughness Optimization for Diffractive Optical Neural Networks

2023-04-04 · Shanglin Zhou, Yingjie Li, Minhan Lou, Weilu Gao, Zhijie Shi, Cunxi Yu, Caiwen Ding

As a representative next-generation device/circuit technology beyond CMOS, diffractive optical neural networks (DONNs) have shown promising advantages over conventional deep neural networks due to extreme fast computation speed (light speed) and low energy consumption. However, there is a mismatch, i.e., significant prediction accuracy loss, between the DONN numerical modelling and physical optical device deployment, because of the interpixel interaction within the diffractive layers. In this work, we propose a physics-aware diffractive optical neural network training framework to reduce the performance difference between numerical modeling and practical deployment. Specifically, we propose the roughness modeling regularization in the training process and integrate the physics-aware sparsification method to introduce sparsity to the phase masks to reduce sharp phase changes between adjacent pixels in diffractive layers. We further develop $2\pi$ periodic optimization to reduce the roughness of the phase masks to preserve the performance of DONN. Experiment results demonstrate that, compared to state-of-the-arts, our physics-aware optimization can provide $35.7\%$, $34.2\%$, $28.1\%$, and $27.3\%$ reduction in roughness with only accuracy loss on MNIST, FMNIST, KMNIST, and EMNIST, respectively.

📄 PDF Abstract BibTeX arXiv:2304.01500

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

Physics-aware Differentiable Discrete Codesign for Diffractive Optical Neural Networks

2022-09-28 · Yingjie Li, Ruiyang Chen, Weilu Gao, Cunxi Yu

Diffractive optical neural networks (DONNs) have attracted lots of attention as they bring significant advantages in terms of power efficiency, parallelism, and computational speed compared with conventional deep neural …

Quantization

Large-Area Fabrication-aware Computational Diffractive Optics

2025-05-28 · Kaixuan Wei, Hector A. Jimenez-Romero, Hadi Amata, Jipeng Sun 외

Differentiable optics, as an emerging paradigm that jointly optimizes optics and (optional) image processing algorithms, has made innovative optical designs possible across a broad range of applications. Many of these sy…

3D geometry

Quantization-Aware Deep Optics for Diffractive Snapshot Hyperspectral Imaging

2022-01-01 · CVPR 2022 1 · Lingen Li, Lizhi Wang, Weitao Song, Lei Zhang 외

Diffractive snapshot hyperspectral imaging based on the deep optics framework has been striving to capture the spectral images of dynamic scenes. However, existing deep optics frameworks all suffer from the mismatch …

Quantization

Beyond the Thin-Layer Limit: Differentiable Volumetric Training for Visible-Range Diffractive Neural Networks

2026-06-05 · Dineth Jayakody, Dushan N. Wadduwage arxiv

Diffractive deep neural networks (D2NNs) promise miniaturized, power-efficient, light-speed optical front-ends for machine vision, yet the most mature demonstrations remain in the terahertz regime, built from readily fab…

QuATON: Quantization Aware Training of Optical Neurons

2023-10-04 · Hasindu Kariyawasam, Ramith Hettiarachchi, Quansan Yang, Alex Matlock 외

Optical processors, built with "optical neurons", can efficiently perform high-dimensional linear operations at the speed of light. Thus they are a promising avenue to accelerate large-scale linear computations. With the…

Quantization