paper-with-me

Papers

Hardware-Aware Graph Neural Network Automated Design for Edge Computing Platforms

2023-03-20 · Ao Zhou, Jianlei Yang, Yingjie Qi, Yumeng Shi, Tong Qiao, Weisheng Zhao, Chunming Hu

Graph neural networks (GNNs) have emerged as a popular strategy for handling non-Euclidean data due to their state-of-the-art performance. However, most of the current GNN model designs mainly focus on task accuracy, lacking in considering hardware resources limitation and real-time requirements of edge application scenarios. Comprehensive profiling of typical GNN models indicates that their execution characteristics are significantly affected across different computing platforms, which demands hardware awareness for efficient GNN designs. In this work, HGNAS is proposed as the first Hardware-aware Graph Neural Architecture Search framework targeting resource constraint edge devices. By decoupling the GNN paradigm, HGNAS constructs a fine-grained design space and leverages an efficient multi-stage search strategy to explore optimal architectures within a few GPU hours. Moreover, HGNAS achieves hardware awareness during the GNN architecture design by leveraging a hardware performance predictor, which could balance the GNN model accuracy and efficiency corresponding to the characteristics of targeted devices. Experimental results show that HGNAS can achieve about $10.6\times$ speedup and $88.2\%$ peak memory reduction with a negligible accuracy loss compared to DGCNN on various edge devices, including Nvidia RTX3080, Jetson TX2, Intel i7-8700K and Raspberry Pi 3B+.

📄 PDF Abstract BibTeX arXiv:2303.10875

Code (0)

등록된 구현이 없습니다.

Tasks

Edge-computingGPUGraph Neural NetworkNeural Architecture Search

Methods 이 논문이 사용한 방법론

DGCNN 설명 없음

Similar Papers 제목 키워드 기반

HGNAS: Hardware-Aware Graph Neural Architecture Search for Edge Devices

2024-08-23 · Ao Zhou, Jianlei Yang, Yingjie Qi, Tong Qiao 외

Graph Neural Networks (GNNs) are becoming increasingly popular for graph-based learning tasks such as point cloud processing due to their state-of-the-art (SOTA) performance. Nevertheless, the research community has prim…

GPUNeural Architecture Search

HAQ: Hardware-Aware Automated Quantization with Mixed Precision

2018-11-21 · CVPR 2019 6 · Kuan Wang, Zhijian Liu, Yujun Lin, Ji Lin 외

Model quantization is a widely used technique to compress and accelerate deep neural network (DNN) inference. Emergent DNN hardware accelerators begin to support mixed precision (1-8 bits) to further improve the computat…

QuantizationReinforcement Learning

Agentic evolution of physically constrained foundation models

2026-06-24 · Jiangwei Zhang, Wen Sun, Chong Wang, Shiyao Li 외 arxiv

Artificial intelligence increasingly drives automated scientific discovery, yet contemporary generalist agents lack physical grounding, frequently hallucinating hardware-incompatible designs. Here, we present a physicall…

EH-DNAS: End-to-End Hardware-aware Differentiable Neural Architecture Search

2021-11-24 · Qian Jiang, Xiaofan Zhang, Deming Chen, Minh N. Do 외

In hardware-aware Differentiable Neural Architecture Search (DNAS), it is challenging to compute gradients of hardware metrics to perform architecture search. Existing works rely on linear approximations with limited sup…

BenchmarkingNeural Architecture Search

Hardware-Centric AutoML for Mixed-Precision Quantization

2020-08-11 · Kuan Wang, Zhijian Liu, Yujun Lin, Ji Lin 외

Model quantization is a widely used technique to compress and accelerate deep neural network (DNN) inference. Emergent DNN hardware accelerators begin to support mixed precision (1-8 bits) to further improve the computat…

AutoMLQuantization