paper-with-me

Papers

Computing Graph Neural Networks: A Survey from Algorithms to Accelerators

2020-09-30 · Sergi Abadal, Akshay Jain, Robert Guirado, Jorge López-Alonso, Eduard Alarcón

Graph Neural Networks (GNNs) have exploded onto the machine learning scene in recent years owing to their capability to model and learn from graph-structured data. Such an ability has strong implications in a wide variety of fields whose data is inherently relational, for which conventional neural networks do not perform well. Indeed, as recent reviews can attest, research in the area of GNNs has grown rapidly and has lead to the development of a variety of GNN algorithm variants as well as to the exploration of groundbreaking applications in chemistry, neurology, electronics, or communication networks, among others. At the current stage of research, however, the efficient processing of GNNs is still an open challenge for several reasons. Besides of their novelty, GNNs are hard to compute due to their dependence on the input graph, their combination of dense and very sparse operations, or the need to scale to huge graphs in some applications. In this context, this paper aims to make two main contributions. On the one hand, a review of the field of GNNs is presented from the perspective of computing. This includes a brief tutorial on the GNN fundamentals, an overview of the evolution of the field in the last decade, and a summary of operations carried out in the multiple phases of different GNN algorithm variants. On the other hand, an in-depth analysis of current software and hardware acceleration schemes is provided, from which a hardware-software, graph-aware, and communication-centric vision for GNN accelerators is distilled.

📄 PDF Abstract BibTeX arXiv:2010.00130

Code (0)

등록된 구현이 없습니다.

Tasks

Survey

Similar Papers 제목 키워드 기반

Lincoln AI Computing Survey (LAICS) Update

2023-10-13 · Albert Reuther, Peter Michaleas, Michael Jones, Vijay Gadepally 외

This paper is an update of the survey of AI accelerators and processors from past four years, which is now called the Lincoln AI Computing Survey - LAICS (pronounced "lace"). As in past years, this paper collects and sum…

Survey

A Survey on Deep Learning Hardware Accelerators for Heterogeneous HPC Platforms

2023-06-27 · Cristina Silvano, Daniele Ielmini, Fabrizio Ferrandi, Leandro Fiorin 외

Recent trends in deep learning (DL) have made hardware accelerators essential for various high-performance computing (HPC) applications, including image classification, computer vision, and speech recognition. This surve…

Deep LearningGPUimage-classificationImage Classification+3

FPGA-Based Neural Network Accelerators for Space Applications: A Survey

2025-04-22 · Pedro Antunes, Artur Podobas

Space missions are becoming increasingly ambitious, necessitating high-performance onboard spacecraft computing systems. In response, field-programmable gate arrays (FPGAs) have garnered significant interest due to their…

Data Compression

Hardware Approximate Techniques for Deep Neural Network Accelerators: A Survey

2022-03-16 · Giorgos Armeniakos, Georgios Zervakis, Dimitrios Soudris, Jörg Henkel

Deep Neural Networks (DNNs) are very popular because of their high performance in various cognitive tasks in Machine Learning (ML). Recent advancements in DNNs have brought beyond human accuracy in many tasks, but at the…

A Survey on Design Methodologies for Accelerating Deep Learning on Heterogeneous Architectures

2023-11-29 · Serena Curzel, Fabrizio Ferrandi, Leandro Fiorin, Daniele Ielmini 외

Given their increasing size and complexity, the need for efficient execution of deep neural networks has become increasingly pressing in the design of heterogeneous High-Performance Computing (HPC) and edge platforms, le…

Deep LearningHigh-Level SynthesisSurvey