Probabilistic Graph Reasoning for Natural Proof Generation
In this paper, we investigate the problem of reasoning over natural language statements. Prior neural based approaches do not explicitly consider the inter-dependency among answers and their proofs. In this paper, we propose PRobr, a novel approach for joint answer prediction and proof generation. PRobr defines a joint probabilistic distribution over all possible proof graphs and answers via an induced graphical model. We then optimize the model using variational approximation on top of neural textual representation. Experiments on multiple datasets under diverse settings (fully supervised, few-shot and zero-shot evaluation) verify the effectiveness of PRobr, e.g., achieving 10%-30% improvement on QA accuracy in few/zero-shot evaluation. Our codes and models can be found at https://github.com/changzhisun/PRobr/.
Code (1)
Similar Papers 제목 키워드 기반
multiPRover: Generating Multiple Proofs for Improved Interpretability in Rule Reasoning
We focus on a type of linguistic formal reasoning where the goal is to reason over explicit knowledge in the form of natural language facts and rules (Clark et al., 2020). A recent work, named PRover (Saha et al., 2020),…
Multi-Label ClassificationMUlTI-LABEL-ClASSIFICATIONAnytime Exact Belief Propagation
Statistical Relational Models and, more recently, Probabilistic Programming, have been making strides towards an integration of logic and probabilistic reasoning. A natural expectation for this project is that a probabil…
Probabilistic ProgrammingLinear Reasoning vs. Proof by Cases: Obstacles for Large Language Models in FOL Problem Solving
To comprehensively evaluate the mathematical reasoning capabilities of Large Language Models (LLMs), researchers have introduced abundant mathematical reasoning datasets. However, most existing datasets primarily focus o…
Mathematical ReasoningAutomating Mathematical Proof Generation Using Large Language Model Agents and Knowledge Graphs
Large Language Models have demonstrated remarkable capabilities in natural language processing tasks, including mathematical problem-solving that requires multi-step logical reasoning. However, challenges persist in auto…
Formal LogicKnowledge GraphsLanguage ModelingLanguage Modelling+5PRover: Proof Generation for Interpretable Reasoning over Rules
Recent work by Clark et al. (2020) shows that transformers can act as 'soft theorem provers' by answering questions over explicitly provided knowledge in natural language. In our work, we take a step closer to emulating …
valid