paper-with-me

홈 › Papers

HDReason: Algorithm-Hardware Codesign for Hyperdimensional Knowledge Graph Reasoning

2024-03-09 · Hanning Chen, Yang Ni, Ali Zakeri, Zhuowen Zou, Sanggeon Yun, Fei Wen, Behnam Khaleghi, Narayan Srinivasa, Hugo Latapie, Mohsen Imani

In recent times, a plethora of hardware accelerators have been put forth for graph learning applications such as vertex classification and graph classification. However, previous works have paid little attention to Knowledge Graph Completion (KGC), a task that is well-known for its significantly higher algorithm complexity. The state-of-the-art KGC solutions based on graph convolution neural network (GCN) involve extensive vertex/relation embedding updates and complicated score functions, which are inherently cumbersome for acceleration. As a result, existing accelerator designs are no longer optimal, and a novel algorithm-hardware co-design for KG reasoning is needed. Recently, brain-inspired HyperDimensional Computing (HDC) has been introduced as a promising solution for lightweight machine learning, particularly for graph learning applications. In this paper, we leverage HDC for an intrinsically more efficient and acceleration-friendly KGC algorithm. We also co-design an acceleration framework named HDReason targeting FPGA platforms. On the algorithm level, HDReason achieves a balance between high reasoning accuracy, strong model interpretability, and less computation complexity. In terms of architecture, HDReason offers reconfigurability, high training throughput, and low energy consumption. When compared with NVIDIA RTX 4090 GPU, the proposed accelerator achieves an average 10.6x speedup and 65x energy efficiency improvement. When conducting cross-models and cross-platforms comparison, HDReason yields an average 4.2x higher performance and 3.4x better energy efficiency with similar accuracy versus the state-of-the-art FPGA-based GCN training platform.

📄 PDF Abstract BibTeX arXiv:2403.05763

Code (0)

등록된 구현이 없습니다.

Tasks

GPUGraph ClassificationGraph LearningKnowledge Graph Completion

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
GCN A Graph Convolutional Network, or GCN, is an approach for semi-supervised learning on graph-structured data. It is based on an efficient variant of [convolutional neural…

Similar Papers 제목 키워드 기반

Best of Both Worlds: AutoML Codesign of a CNN and its Hardware Accelerator

2020-02-11 · Mohamed S. Abdelfattah, Łukasz Dudziak, Thomas Chau, Royson Lee 외

Neural architecture search (NAS) has been very successful at outperforming human-designed convolutional neural networks (CNN) in accuracy, and when hardware information is present, latency as well. However, NAS-designed …

AutoMLGeneral ClassificationGPUimage-classification+4

Tailor: Altering Skip Connections for Resource-Efficient Inference

2023-01-18 · Olivia Weng, Gabriel Marcano, Vladimir Loncar, Alireza Khodamoradi 외

Deep neural networks use skip connections to improve training convergence. However, these skip connections are costly in hardware, requiring extra buffers and increasing on- and off-chip memory utilization and bandwidth …

Hyperdimensional Computing with Spiking-Phasor Neurons

2023-02-28 · Jeff Orchard, Russell Jarvis

Vector Symbolic Architectures (VSAs) are a powerful framework for representing compositional reasoning. They lend themselves to neural-network implementations, allowing us to create neural networks that can perform cogni…

Spatial Reasoning

Surrogate Neural Architecture Codesign Package (SNAC-Pack)

2025-12-17 · Jason Weitz, Dmitri Demler, Benjamin Hawks, Nhan Tran 외 arxiv

Neural Architecture Search is a powerful approach for automating model design, but existing methods struggle to accurately optimize for real hardware performance, often relying on proxy metrics such as bit operations. We…

Neural Architecture Search

Neural Architecture Codesign for Fast Bragg Peak Analysis

2023-12-10 · Luke McDermott, Jason Weitz, Dmitri Demler, Daniel Cummings 외

We develop an automated pipeline to streamline neural architecture codesign for fast, real-time Bragg peak analysis in high-energy diffraction microscopy. Traditional approaches, notably pseudo-Voigt fitting, demand sign…

AutoMLModel CompressionNetwork PruningNeural Architecture Search+1