paper-with-me

홈 › Papers

Are LLMs Better GNN Helpers? Rethinking Robust Graph Learning under Deficiencies with Iterative Refinement

2025-10-02 · Zhaoyan Wang, Zheng Gao, Arogya Kharel, In-Young Ko arxiv

Graph Neural Networks (GNNs) are widely adopted in Web-related applications, serving as a core technique for learning from graph-structured data, such as text-attributed graphs. Yet in real-world scenarios, such graphs exhibit deficiencies that substantially undermine GNN performance. While prior GNN-based augmentation studies have explored robustness against individual imperfections, a systematic understanding of how graph-native and Large Language Models (LLMs) enhanced methods behave under compound deficiencies is still missing. Specifically, there has been no comprehensive investigation comparing conventional approaches and recent LLM-on-graph frameworks, leaving their merits unclear. To fill this gap, we conduct the first empirical study that benchmarks these two lines of methods across diverse graph deficiencies, revealing overlooked vulnerabilities and challenging the assumption that LLM augmentation is consistently superior. Building on empirical findings, we propose Robust Graph Learning via Retrieval-Augmented Contrastive Refinement (RoGRAD) framework. Unlike prior one-shot LLM-as-Enhancer designs, RoGRAD is the first iterative paradigm that leverages Retrieval-Augmented Generation (RAG) to inject retrieval-grounded augmentations by supplying class-consistent, diverse augmentations and enforcing discriminative representations through iterative graph contrastive learning. It transforms LLM augmentation for graphs from static signal injection into dynamic refinement. Extensive experiments demonstrate RoGRAD's superiority over both conventional GNN- and LLM-enhanced baselines, achieving up to 82.43% average improvement.

📄 PDF Abstract BibTeX arXiv:2510.01910

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningGraph Learning

Similar Papers 제목 키워드 기반

Improving Causal Reasoning in Large Language Models: A Survey

2024-10-22 · Longxuan Yu, Delin Chen, Siheng Xiong, Qingyang Wu 외

Causal reasoning (CR) is a crucial aspect of intelligence, essential for problem-solving, decision-making, and understanding the world. While large language models (LLMs) can generate rationales for their outputs, their …

Decision MakingSurvey

Online library learning in human visual puzzle solving

2026-03-24 · Pinzhe Zhao, Emanuele Sansone, Marta Kryven, Bonan Zhao arxiv

When learning a novel complex task, people often form efficient reusable abstractions that simplify future work, despite uncertainty about the future. We study this process in a visual puzzle task where participants defi…

Rethinking and Benchmarking Large Language Models for Graph Reasoning

2025-09-29 · Yuwei Hu, Xinyi Huang, Zhewei Wei, Yongchao Liu 외 arxiv

Large Language Models (LLMs) for Graph Reasoning have been extensively studied over the past two years, involving enabling LLMs to understand graph structures and reason on graphs to solve various graph problems, with gr…

Makespan Minimization in Split Learning: From Theory to Practice

2026-02-06 · Robert Ganian, Fionn Mc Inerney, Dimitra Tsigkari arxiv

Split learning recently emerged as a solution for distributed machine learning with heterogeneous IoT devices, where clients can offload part of their training to computationally-powerful helpers. The core challenge in s…

LoReC: Rethinking Large Language Models for Graph Data Analysis

2026-04-20 · Hongyu Zhan, Qixin Wang, Yusen Tan, Haitao Yu 외 arxiv

The advent of Large Language Models (LLMs) has fundamentally reshaped the way we interact with graphs, giving rise to a new paradigm called GraphLLM. As revealed in recent studies, graph learning can benefit from LLMs. H…

Graph Learning