paper-with-me

Papers

GHOST: A Graph Neural Network Accelerator using Silicon Photonics

2023-07-04 · Salma Afifi, Febin Sunny, Amin Shafiee, Mahdi Nikdast, Sudeep Pasricha

Graph neural networks (GNNs) have emerged as a powerful approach for modelling and learning from graph-structured data. Multiple fields have since benefitted enormously from the capabilities of GNNs, such as recommendation systems, social network analysis, drug discovery, and robotics. However, accelerating and efficiently processing GNNs require a unique approach that goes beyond conventional artificial neural network accelerators, due to the substantial computational and memory requirements of GNNs. The slowdown of scaling in CMOS platforms also motivates a search for alternative implementation substrates. In this paper, we present GHOST, the first silicon-photonic hardware accelerator for GNNs. GHOST efficiently alleviates the costs associated with both vertex-centric and edge-centric operations. It implements separately the three main stages involved in running GNNs in the optical domain, allowing it to be used for the inference of various widely used GNN models and architectures, such as graph convolution networks and graph attention networks. Our simulation studies indicate that GHOST exhibits at least 10.2x better throughput and 3.8x better energy efficiency when compared to GPU, TPU, CPU and multiple state-of-the-art GNN hardware accelerators.

📄 PDF Abstract BibTeX arXiv:2307.01782

Code (0)

등록된 구현이 없습니다.

Tasks

CPUDrug DiscoveryGPUGraph AttentionGraph Neural NetworkRecommendation Systems

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Accelerating Neural Networks for Large Language Models and Graph Processing with Silicon Photonics

2024-01-12 · Salma Afifi, Febin Sunny, Mahdi Nikdast, Sudeep Pasricha

In the rapidly evolving landscape of artificial intelligence, large language models (LLMs) and graph processing have emerged as transformative technologies for natural language processing (NLP), computer vision, and grap…

Accelerating Diffusion Models for Generative AI Applications with Silicon Photonics

2026-03-08 · Tharini Suresh, Salma Afifi, Sudeep Pasricha arxiv

Diffusion models have revolutionized generative AI, with their inherent capacity to generate highly realistic state-of-the-art synthetic data. However, these models employ an iterative denoising process over computationa…

SONIC: A Sparse Neural Network Inference Accelerator with Silicon Photonics for Energy-Efficient Deep Learning

2021-09-09 · Febin Sunny, Mahdi Nikdast, Sudeep Pasricha

Sparse neural networks can greatly facilitate the deployment of neural networks on resource-constrained platforms as they offer compact model sizes while retaining inference accuracy. Because of the sparsity in parameter…

Towards Efficient Hyperdimensional Computing Using Photonics

2023-11-29 · Farbin Fayza, Cansu Demirkiran, Hanning Chen, Che-Kai Liu 외

Over the past few years, silicon photonics-based computing has emerged as a promising alternative to CMOS-based computing for Deep Neural Networks (DNN). Unfortunately, the non-linear operations and the high-precision re…

Monolithic Silicon-Photonics Linear-Algebra Accelerators Enabling Next-Gen Massive MIMO

2024-02-13 · Tzu-Chien Hsueh, Yeshaiahu Fainman, Bill Lin

A system-on-chip (SoC) photonic-electronic linear-algebra accelerator with the features of wavelength-division-multiplexing (WDM) based broadband photodetections and high-dimensional matrix-inversion operations fabricate…