LoRAP: Low-Rank Aggregation Prompting for Quantized Graph Neural Networks Training

2026-01-21 · Chenyu Liu, Haige Li, Luca Rossi arxiv

Graph Neural Networks (GNNs) are neural networks that aim to process graph data, capturing the relationships and interactions between nodes using the message-passing mechanism. GNN quantization has emerged as a promising approach for reducing model size and accelerating inference in resource-constrained environments. Compared to quantization in LLMs, quantizing graph features is more emphasized in GNNs. Inspired by the above, we propose to leverage prompt learning, which manipulates the input data, to improve the performance of quantization-aware training (QAT) for GNNs. To mitigate the issue that prompting the node features alone can only make part of the quantized aggregation result optimal, we introduce Low-Rank Aggregation Prompting (LoRAP), which injects lightweight, input-dependent prompts into each aggregated feature to optimize the results of quantized aggregations. Extensive evaluations on 4 leading QAT frameworks over 9 graph datasets demonstrate that LoRAP consistently enhances the performance of low-bit quantized GNNs while introducing a minimal computational overhead.

📄 PDF Abstract BibTeX arXiv:2601.15079

Code (0)

등록된 구현이 없습니다.

LoRAPrune: Structured Pruning Meets Low-Rank Parameter-Efficient Fine-Tuning

2023-05-28 · Mingyang Zhang, Hao Chen, Chunhua Shen, Zhen Yang 외

Large Language Models (LLMs), such as LLaMA and T5, have shown exceptional performance across various tasks through fine-tuning. Although low-rank adaption (LoRA) has emerged to cheaply fine-tune these LLMs on downstream…

Model Compression Network Pruning parameter-efficient fine-tuning

LoRAP: Transformer Sub-Layers Deserve Differentiated Structured Compression for Large Language Models

2024-04-15 · Guangyan Li, Yongqiang Tang, Wensheng Zhang

Large language models (LLMs) show excellent performance in difficult tasks, but they often require massive memories and computational resources. How to reduce the parameter scale of LLMs has become research hotspots. In …

Quick and Reliable LoRa Physical-layer Data Aggregation through Multi-Packet Reception

2022-12-13 · Lizhao You, Zhirong Tang, Pengbo Wang, Zhaorui Wang 외

This paper presents a Long Range (LoRa) physical-layer data aggregation system (LoRaPDA) that aggregates data (e.g., sum, average, min, max) directly in the physical layer. In particular, after coordinating a few nodes t…

Decoder

Verifying Quantized GNNs With Readout Is Decidable But Highly Intractable

2025-10-09 · Artem Chernobrovkin, Marco Sälzer, François Schwarzentruber, Nicolas Troquard arxiv

We introduce a logical language for reasoning about quantized aggregate-combine graph neural networks with global readout (ACR-GNNs). We provide a logical characterization and use it to prove that verification tasks for …

Evaluating Open-Weight Large Language Models for Structured Data Extraction from Narrative Medical Reports Across Multiple Use Cases and Languages

2025-11-03 · Douwe J. Spaanderman, Karthik Prathaban, Petr Zelina, Kaouther Mouheb 외 arxiv

Large language models (LLMs) are increasingly used to extract structured information from free-text clinical records, but prior work often focuses on single tasks, limited models, and English-language reports. We evaluat…