paper-with-me

홈 › Papers

An Optical Frontend for a Convolutional Neural Network

2018-12-23 · Shane Colburn, Yi Chu, Eli Shlizerman, Arka Majumdar

The parallelism of optics and the miniaturization of optical components using nanophotonic structures, such as metasurfaces present a compelling alternative to electronic implementations of convolutional neural networks. The lack of a low-power optical nonlinearity, however, requires slow and energy-inefficient conversions between the electronic and optical domains. Here, we design an architecture which utilizes a single electrical to optical conversion by designing a free-space optical frontend unit that implements the linear operations of the first layer with the subsequent layers realized electronically. Speed and power analysis of the architecture indicates that the hybrid photonic-electronic architecture outperforms sole electronic architecture for large image sizes and kernels. Benchmarking of the photonic-electronic architecture on a modified version of AlexNet achieves a classification accuracy of 87% on images from the Kaggle Cats and Dogs challenge database.

📄 PDF Abstract BibTeX arXiv:1901.03661

Code (0)

등록된 구현이 없습니다.

Tasks

Benchmarking

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Local Response Normalization Local Response Normalization is a normalization layer that implements the idea of lateral inhibition. Lateral inhibition is a concept in neurobiology that refers to the…
Grouped Convolution A Grouped Convolution uses a group of convolutions - multiple kernels per layer - resulting in multiple channel outputs per layer. This leads to wider networks helping a…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Similar Papers 제목 키워드 기반

Compressed Meta-Optical Encoder for Image Classification

2024-04-23 · Anna Wirth-Singh, Jinlin Xiang, Minho Choi, Johannes E. Fröch 외

Optical and hybrid convolutional neural networks (CNNs) recently have become of increasing interest to achieve low-latency, low-power image classification and computer vision tasks. However, implementing optical nonlinea…

Classificationimage-classificationImage ClassificationKnowledge Distillation

Transferable polychromatic optical encoder for neural networks

2024-11-05 · Minho Choi, Jinlin Xiang, Anna Wirth-Singh, Seung-Hwan Baek 외

Artificial neural networks (ANNs) have fundamentally transformed the field of computer vision, providing unprecedented performance. However, these ANNs for image processing demand substantial computational resources, oft…

Characterization of the frequency response of channel-interleaved photonic ADCs based on the optical time-division demultiplexer

2021-09-03 · Na Qian, Linbo Zhang, Jianping Chen, Weiwen Zou

We characterize the frequency response of channel-interleaved photonic analog-to-digital converters (CI-PADCs) theoretically and experimentally. The CI-PADC is composed of a photonic frontend for photonic sampling and an…

Quantization

Neural Tangent Knowledge Distillation for Optical Convolutional Networks

2025-08-11 · Jinlin Xiang, Minho Choi, Yubo Zhang, Zhihao Zhou 외 arxiv

Hybrid Optical Neural Networks (ONNs, typically consisting of an optical frontend and a digital backend) offer an energy-efficient alternative to fully digital deep networks for real-time, power-constrained systems. Howe…

Knowledge DistillationImage Classification

Self-Improving Visual Odometry

2018-12-08 · Daniel DeTone, Tomasz Malisiewicz, Andrew Rabinovich

We propose a self-supervised learning framework that uses unlabeled monocular video sequences to generate large-scale supervision for training a Visual Odometry (VO) frontend, a network which computes pointwise data asso…

2D Pose EstimationPose EstimationSelf-Supervised LearningVisual Odometry