paper-with-me

Papers

Parameter-Efficient Tuning Large Language Models for Graph Representation Learning

2024-04-28 · Qi Zhu, Da Zheng, Xiang Song, Shichang Zhang, Bowen Jin, Yizhou Sun, George Karypis

Text-rich graphs, which exhibit rich textual information on nodes and edges, are prevalent across a wide range of real-world business applications. Large Language Models (LLMs) have demonstrated remarkable abilities in understanding text, which also introduced the potential for more expressive modeling in text-rich graphs. Despite these capabilities, efficiently applying LLMs to representation learning on graphs presents significant challenges. Recently, parameter-efficient fine-tuning methods for LLMs have enabled efficient new task generalization with minimal time and memory consumption. Inspired by this, we introduce Graph-aware Parameter-Efficient Fine-Tuning - GPEFT, a novel approach for efficient graph representation learning with LLMs on text-rich graphs. Specifically, we utilize a graph neural network (GNN) to encode structural information from neighboring nodes into a graph prompt. This prompt is then inserted at the beginning of the text sequence. To improve the quality of graph prompts, we pre-trained the GNN to assist the frozen LLM in predicting the next token in the node text. Compared with existing joint GNN and LMs, our method directly generate the node embeddings from large language models with an affordable fine-tuning cost. We validate our approach through comprehensive experiments conducted on 8 different text-rich graphs, observing an average improvement of 2% in hit@1 and Mean Reciprocal Rank (MRR) in link prediction evaluations. Our results demonstrate the efficacy and efficiency of our model, showing that it can be smoothly integrated with various large language models, including OPT, LLaMA and Falcon.

📄 PDF Abstract BibTeX arXiv:2404.18271

Code (0)

등록된 구현이 없습니다.

Tasks

Graph Neural NetworkGraph Representation LearningLink Predictionparameter-efficient fine-tuningRepresentation Learning

Methods 이 논문이 사용한 방법론

OPT OPT is a suite of decoder-only pre-trained transformers ranging from 125M to 175B parameters. The model uses an AdamW optimizer and weight decay of 0.1. It follows a linear…
LLaMA LLaMA is a collection of foundation language models ranging from 7B to 65B parameters. It is based on the transformer architecture with various improvements that were…
Graph Neural Network 설명 없음

Similar Papers 제목 키워드 기반

TinyGraphEstimator: Adapting Lightweight Language Models for Graph Structure Inference

2025-10-09 · Michal Podstawski arxiv

Graphs provide a universal framework for representing complex relational systems, and inferring their structural properties is a core challenge in graph analysis and reasoning. While large language models have recently d…

GRIP: In-Parameter Graph Reasoning through Fine-Tuning Large Language Models

2025-11-06 · Jiarui Feng, Donghong Cai, Yixin Chen, Muhan Zhang arxiv

Large Language Models (LLMs) have demonstrated remarkable capabilities in modeling sequential textual data and generalizing across diverse tasks. However, adapting LLMs to effectively handle structural data, such as know…

Test-time AdaptationKnowledge Graphs

LLaMo: Large Language Model-based Molecular Graph Assistant

2024-10-31 · Jinyoung Park, Minseong Bae, Dohwan Ko, Hyunwoo J. Kim

Large Language Models (LLMs) have demonstrated remarkable generalization and instruction-following capabilities with instruction tuning. The advancements in LLMs and instruction tuning have led to the development of Larg…

Instruction FollowingIUPAC Name PredictionLanguage ModelingLanguage Modelling+4

FairLLaVA: Fairness-Aware Parameter-Efficient Fine-Tuning for Large Vision-Language Assistants

2026-03-27 · Mahesh Bhosale, Abdul Wasi, Shantam Srivastava, Shifa Latif 외 arxiv

While powerful in image-conditioned generation, multimodal large language models (MLLMs) can display uneven performance across demographic groups, highlighting fairness risks. In safety-critical clinical settings, such d…

parameter-efficient fine-tuningvisual instruction followingVisual Question Answering

Transducer Tuning: Efficient Model Adaptation for Software Tasks Using Code Property Graphs

2024-12-18 · Imam Nur Bani Yusuf, Lingxiao Jiang

Large language models have demonstrated promising performance across various software engineering tasks. While fine-tuning is a common practice to adapt these models for downstream tasks, it becomes challenging in resour…

Code SummarizationCode TranslationLarge Language Model