A Context-Enhanced Framework for Sequential Graph Reasoning
The paper studies sequential reasoning over graph-structured data, which stands as a fundamental task in various trending fields like automated math problem solving and neural graph algorithm learning, attracting a lot of research interest. Simultaneously managing both sequential and graph-structured information in such tasks presents a notable challenge. Over recent years, many neural architectures in the literature have emerged to tackle the issue. In this work, we generalize the existing architectures and propose a context-enhanced framework. The crucial innovation is that the reasoning of each step does not only rely on the outcome of the preceding step but also leverages the aggregation of information from more historical outcomes. The idea stems from our observation that in sequential graph reasoning, each step's outcome has a much stronger inner connection with each other compared to traditional seq-to-seq tasks. We show that the framework can effectively integrate with the existing methods, enhancing their reasoning abilities. Empirical evaluations are conducted on the challenging CLRS Reasoning Benchmark, and the results demonstrate that the proposed framework significantly improves the performance of existing architectures, yielding state-of-the-art results across the majority of the datasets within the benchmark.
Code (1)
Tasks
MathSimilar Papers 제목 키워드 기반
Topology of Reasoning: Retrieved Cell Complex-Augmented Generation for Textual Graph Question Answering
Retrieval-Augmented Generation (RAG) enhances the reasoning ability of Large Language Models (LLMs) by dynamically integrating external knowledge, thereby mitigating hallucinations and strengthening contextual grounding …
Graph Question AnsweringHistory Semantic Graph Enhanced Conversational KBQA with Temporal Information Modeling
Context information modeling is an important task in conversational KBQA. However, existing methods usually assume the independence of utterances and model them in isolation. In this paper, we propose a History Semantic …
Question AnsweringCADGE: Context-Aware Dialogue Generation Enhanced with Graph-Structured Knowledge Aggregation
Commonsense knowledge is crucial to many natural language processing tasks. Existing works usually incorporate graph knowledge with conventional graph neural networks (GNNs), resulting in a sequential pipeline that compa…
Dialogue GenerationGraph AttentionKnowledge GraphsRepresentation LearningMulti-Modal Hypergraph Enhanced LLM Learning for Recommendation
The burgeoning presence of Large Language Models (LLM) is propelling the development of personalized recommender systems. Most existing LLM-based methods fail to sufficiently explore the multi-view graph structure correl…
Contrastive LearningMultimodal RecommendationRecommendation SystemsG-ReAct: Graph-Guided Deep Search via Structure-State Co-Evolution
Deep search has become a fundamental capability of large language models (LLMs) for solving open-domain complex tasks. However, existing approaches typically rely on linear sequential reasoning for both trajectory genera…