paper-with-me

Papers

GraphTranslator: Aligning Graph Model to Large Language Model for Open-ended Tasks

2024-02-11 · Mengmei Zhang, Mingwei Sun, Peng Wang, Shen Fan, Yanhu Mo, Xiaoxiao Xu, Hong Liu, Cheng Yang, Chuan Shi

Large language models (LLMs) like ChatGPT, exhibit powerful zero-shot and instruction-following capabilities, have catalyzed a revolutionary transformation across diverse fields, especially for open-ended tasks. While the idea is less explored in the graph domain, despite the availability of numerous powerful graph models (GMs), they are restricted to tasks in a pre-defined form. Although several methods applying LLMs to graphs have been proposed, they fail to simultaneously handle the pre-defined and open-ended tasks, with LLM as a node feature enhancer or as a standalone predictor. To break this dilemma, we propose to bridge the pretrained GM and LLM by a Translator, named GraphTranslator, aiming to leverage GM to handle the pre-defined tasks effectively and utilize the extended interface of LLMs to offer various open-ended tasks for GM. To train such Translator, we propose a Producer capable of constructing the graph-text alignment data along node information, neighbor information and model information. By translating node representation into tokens, GraphTranslator empowers an LLM to make predictions based on language instructions, providing a unified perspective for both pre-defined and open-ended tasks. Extensive results demonstrate the effectiveness of our proposed GraphTranslator on zero-shot node classification. The graph question answering experiments reveal our GraphTranslator potential across a broad spectrum of open-ended tasks through language instructions. Our code is available at: https://github.com/alibaba/GraphTranslator.

📄 PDF Abstract BibTeX arXiv:2402.07197

Code (1)

alibaba/graphtranslator 공식 구현 pytorch

Tasks

Graph Question AnsweringInstruction FollowingLanguage ModelingLanguage ModellingLarge Language ModelmodelNode ClassificationQuestion Answering

Similar Papers 제목 키워드 기반

CogMG: Collaborative Augmentation Between Large Language Model and Knowledge Graph

2024-06-25 · Tong Zhou, Yubo Chen, Kang Liu, Jun Zhao

Large language models have become integral to question-answering applications despite their propensity for generating hallucinations and factually inaccurate content. Querying knowledge graphs to reduce hallucinations in…

Knowledge Graph CompletionKnowledge GraphsLanguage ModelingLanguage Modelling+2

Relation-aware Hierarchical Prompt for Open-vocabulary Scene Graph Generation

2024-12-26 · Tao Liu, Rongjie Li, Chongyu Wang, Xuming He

Open-vocabulary Scene Graph Generation (OV-SGG) overcomes the limitations of the closed-set assumption by aligning visual relationship representations with open-vocabulary textual representations. This enables the identi…

Graph GenerationLarge Language ModelRelationScene Graph Generation+1

LLMs Meet VLMs: Boost Open Vocabulary Object Detection with Fine-grained Descriptors

2024-02-07 · Sheng Jin, Xueying Jiang, Jiaxing Huang, Lewei Lu 외

Inspired by the outstanding zero-shot capability of vision language models (VLMs) in image classification tasks, open-vocabulary object detection has attracted increasing interest by distilling the broad VLM knowledge in…

image-classificationImage Classificationobject-detectionObject Detection+2

Control Barrier Function for Aligning Large Language Models

2025-11-05 · Yuya Miyaoka, Masaki Inoue arxiv

This paper proposes a control-based framework for aligning large language models (LLMs) by leveraging a control barrier function (CBF) to ensure user-desirable text generation. The presented framework applies the CBF saf…

Text Generation

Sinhala-English Parallel Word Dictionary Dataset

2023-08-04 · Kasun Wickramasinghe, Nisansa de Silva

Parallel datasets are vital for performing and evaluating any kind of multilingual task. However, in the cases where one of the considered language pairs is a low-resource language, the existing top-down parallel data su…

Machine TranslationSentence