paper-with-me

홈 › Papers

End-to-End Graph Flattening Method for Large Language Models

2024-09-23 · Bin Hong, Jinze Wu, Jiayu Liu, Liang Ding, Jing Sha, Kai Zhang, Shijin Wang, Zhenya Huang

In recent years, the breakthrough of Large Language Models (LLMs) offers new ideas for achieving universal methods on graph data. The common practice of converting graphs into natural language for LLMs, which refers to graph flattening, exhibits good generalizability and interpretability. However, the poor organization of the textual format results in poor performance in long-distance scenario understanding. Inspired by human cognitive reasoning habits, we propose a novel method for graph flattening to fit LLMs, termed as End-to-End DAG-Path prompting (EEDP). Experiments on real-world datasets show that EEDP enhances the reasoning performance of LLMs in long-distance scenarios while maintaining excellent performance in short-distance scenarios, demonstrating good robustness in the face of distance variations.

📄 PDF Abstract BibTeX arXiv:2409.14880

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Rethinking Critic Learning in PPO: Understanding and Mitigating Value Flattening

2026-09-16 · Yizhuo Li, Jianhao Yan, Yun Luo, Zhi Wang 외 hf

In reinforcement learning for large language models, Proximal Policy Optimization (PPO) commonly uses a critic to estimate state values and reduce the variance of policy updates. However, we uncover a systematic failure …

Reinforcement Learning

Evaluation of the relative performance of the subflattenings method for phylogenetic inference

2022-05-04 · Joshua Stevenson, Barbara Holland, Michael Charleston, Jeremy Sumner

The algebraic properties of flattenings and subflattenings provide direct methods for identifying edges in the true phylogeny -- and by extension the complete tree -- using pattern counts from a sequence alignment. The r…

Flatten Graphs as Sequences: Transformers are Scalable Graph Generators

2025-02-04 · Dexiong Chen, Markus Krimmel, Karsten Borgwardt

We introduce AutoGraph, a novel autoregressive framework for generating large attributed graphs using decoder-only transformers. At the core of our approach is a reversible "flattening" process that transforms graphs int…

DecoderGraph GenerationLanguage ModelingLanguage Modelling+1

Rethinking the Zigzag Flattening for Image Reading

2022-02-21 · Qingsong Zhao, Yi Wang, Zhipeng Zhou, Duoqian Miao 외

Sequence ordering of word vector matters a lot to text reading, which has been proven in natural language processing (NLP). However, the rule of different sequence ordering in computer vision (CV) was not well explored, …

Image ClassificationRepresentation LearningSemantic Segmentation

CodeKGC: Code Language Model for Generative Knowledge Graph Construction

2023-04-18 · Zhen Bi, Jing Chen, Yinuo Jiang, Feiyu Xiong 외

Current generative knowledge graph construction approaches usually fail to capture structural knowledge by simply flattening natural language into serialized texts or a specification language. However, large generative l…

Code Completiongraph constructionLanguage ModelingLanguage Modelling