paper-with-me

홈 › Papers

PhotoFourier: A Photonic Joint Transform Correlator-Based Neural Network Accelerator

2022-11-10 · Shurui Li, Hangbo Yang, Chee Wei Wong, Volker J. Sorger, Puneet Gupta

The last few years have seen a lot of work to address the challenge of low-latency and high-throughput convolutional neural network inference. Integrated photonics has the potential to dramatically accelerate neural networks because of its low-latency nature. Combined with the concept of Joint Transform Correlator (JTC), the computationally expensive convolution functions can be computed instantaneously (time of flight of light) with almost no cost. This 'free' convolution computation provides the theoretical basis of the proposed PhotoFourier JTC-based CNN accelerator. PhotoFourier addresses a myriad of challenges posed by on-chip photonic computing in the Fourier domain including 1D lenses and high-cost optoelectronic conversions. The proposed PhotoFourier accelerator achieves more than 28X better energy-delay product compared to state-of-art photonic neural network accelerators.

📄 PDF Abstract BibTeX arXiv:2211.05276

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

TRON: Transformer Neural Network Acceleration with Non-Coherent Silicon Photonics

2023-03-22 · Salma Afifi, Febin Sunny, Mahdi Nikdast, Sudeep Pasricha

Transformer neural networks are rapidly being integrated into state-of-the-art solutions for natural language processing (NLP) and computer vision. However, the complex structure of these models creates challenges for ac…

MDTransformer: A Hardware-Software Co-Design of Mode-Division Photonic Transformer Accelerator with Inverse-Designed Coherent Crossbar

2026-07-28 · Solomon Micheal Serunjogi, Rachmad Vidya Wicaksana Putra, Ayat Taha, Muhammad Shafique 외 arxiv

Recently, photonic transformer accelerators (PTAs) have successfully achieved significant speedup and energy efficiency improvements over electronic accelerators for expediting Transformer inference. However, state-of-th…

Photonic Accelerators for Image Segmentation in Autonomous Driving and Defect Detection

2023-09-28 · Lakshmi Nair, David Widemann, Brad Turcott, Nick Moore 외

Photonic computing promises faster and more energy-efficient deep neural network (DNN) inference than traditional digital hardware. Advances in photonic computing can have profound impacts on applications such as autonom…

Autonomous DrivingDefect DetectionImage SegmentationSegmentation+1

Sustainable Transformer Neural Network Acceleration with Stochastic Photonic Computing

2026-04-10 · S. Afifi, O. Alo, I. Thakkar, S. Pasricha arxiv

Transformers achieve state-of-the-art performance in natural language processing, vision, and scientific computing, but demand high computation and memory. To address these challenges, we present ASTRA, the first silicon…

Silicon Photonic Microring Based Chip-Scale Accelerator for Delayed Feedback Reservoir Computing

2021-01-03 · Sairam Sri Vatsavai, Ishan Thakkar

To perform temporal and sequential machine learning tasks, the use of conventional Recurrent Neural Networks (RNNs) has been dwindling due to the training complexities of RNNs. To this end, accelerators for delayed feedb…

Time Series Analysis