paper-with-me

Papers

Time-lapse image classification using a diffractive neural network

2022-08-23 · Md Sadman Sakib Rahman, Aydogan Ozcan

Diffractive deep neural networks (D2NNs) define an all-optical computing framework comprised of spatially engineered passive surfaces that collectively process optical input information by modulating the amplitude and/or the phase of the propagating light. Diffractive optical networks complete their computational tasks at the speed of light propagation through a thin diffractive volume, without any external computing power while exploiting the massive parallelism of optics. Diffractive networks were demonstrated to achieve all-optical classification of objects and perform universal linear transformations. Here we demonstrate, for the first time, a "time-lapse" image classification scheme using a diffractive network, significantly advancing its classification accuracy and generalization performance on complex input objects by using the lateral movements of the input objects and/or the diffractive network, relative to each other. In a different context, such relative movements of the objects and/or the camera are routinely being used for image super-resolution applications; inspired by their success, we designed a time-lapse diffractive network to benefit from the complementary information content created by controlled or random lateral shifts. We numerically explored the design space and performance limits of time-lapse diffractive networks, revealing a blind testing accuracy of 62.03% on the optical classification of objects from the CIFAR-10 dataset. This constitutes the highest inference accuracy achieved so far using a single diffractive network on the CIFAR-10 dataset. Time-lapse diffractive networks will be broadly useful for the spatio-temporal analysis of input signals using all-optical processors.

📄 PDF Abstract BibTeX arXiv:2208.10802

Code (0)

등록된 구현이 없습니다.

Tasks

Classificationimage-classificationImage ClassificationImage Super-ResolutionSuper-Resolution

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

Classification and reconstruction of spatially overlapping phase images using diffractive optical networks

2021-08-18 · Deniz Mengu, Muhammed Veli, Yair Rivenson, Aydogan Ozcan

Diffractive optical networks unify wave optics and deep learning to all-optically compute a given machine learning or computational imaging task as the light propagates from the input to the output plane. Here, we report…

Classificationimage-classificationImage ClassificationRetrieval

Spectrally-Encoded Single-Pixel Machine Vision Using Diffractive Networks

2020-05-15 · Jingxi Li, Deniz Mengu, Nezih T. Yardimci, Yi Luo 외

3D engineering of matter has opened up new avenues for designing systems that can perform various computational tasks through light-matter interaction. Here, we demonstrate the design of optical networks in the form of m…

General Classification

Ensemble learning of diffractive optical networks

2020-09-15 · Md Sadman Sakib Rahman, Jingxi Li, Deniz Mengu, Yair Rivenson 외

A plethora of research advances have emerged in the fields of optics and photonics that benefit from harnessing the power of machine learning. Specifically, there has been a revival of interest in optical computing hardw…

BIG-bench Machine LearningClassificationEnsemble LearningFeature Engineering+3

Snapshot Multispectral Imaging Using a Diffractive Optical Network

2022-12-10 · Deniz Mengu, Anika Tabassum, Mona Jarrahi, Aydogan Ozcan

Multispectral imaging has been used for numerous applications in e.g., environmental monitoring, aerospace, defense, and biomedicine. Here, we present a diffractive optical network-based multispectral imaging system trai…

All-optical image classification through unknown random diffusers using a single-pixel diffractive network

2022-08-08 · Yi Luo, Bijie Bai, Yuhang Li, Ege Cetintas 외

Classification of an object behind a random and unknown scattering medium sets a challenging task for computational imaging and machine vision fields. Recent deep learning-based approaches demonstrated the classification…

AllAutonomous Drivingimage-classificationImage Classification+1