paper-with-me

Papers

Probabilistic Graph Reasoning for Natural Proof Generation

2021-07-06 · Findings (ACL) 2021 8 · Changzhi Sun, Xinbo Zhang, Jiangjie Chen, Chun Gan, Yuanbin Wu, Jiaze Chen, Hao Zhou, Lei LI

In this paper, we investigate the problem of reasoning over natural language statements. Prior neural based approaches do not explicitly consider the inter-dependency among answers and their proofs. In this paper, we propose PRobr, a novel approach for joint answer prediction and proof generation. PRobr defines a joint probabilistic distribution over all possible proof graphs and answers via an induced graphical model. We then optimize the model using variational approximation on top of neural textual representation. Experiments on multiple datasets under diverse settings (fully supervised, few-shot and zero-shot evaluation) verify the effectiveness of PRobr, e.g., achieving 10%-30% improvement on QA accuracy in few/zero-shot evaluation. Our codes and models can be found at https://github.com/changzhisun/PRobr/.

📄 PDF Abstract BibTeX arXiv:2107.02418

Code (1)

changzhisun/PRobr 공식 구현 pytorch

Similar Papers 제목 키워드 기반

multiPRover: Generating Multiple Proofs for Improved Interpretability in Rule Reasoning

2021-06-02 · NAACL 2021 4 · Swarnadeep Saha, Prateek Yadav, Mohit Bansal

We focus on a type of linguistic formal reasoning where the goal is to reason over explicit knowledge in the form of natural language facts and rules (Clark et al., 2020). A recent work, named PRover (Saha et al., 2020),…

Multi-Label ClassificationMUlTI-LABEL-ClASSIFICATION

Anytime Exact Belief Propagation

2017-07-27 · Gabriel Azevedo Ferreira, Quentin Bertrand, Charles Maussion, Rodrigo de Salvo Braz

Statistical Relational Models and, more recently, Probabilistic Programming, have been making strides towards an integration of logic and probabilistic reasoning. A natural expectation for this project is that a probabil…

Probabilistic Programming

Linear Reasoning vs. Proof by Cases: Obstacles for Large Language Models in FOL Problem Solving

2026-02-24 · Yuliang Ji, Fuchen Shen, Jian Wu, Qiujie Xie 외 arxiv

To comprehensively evaluate the mathematical reasoning capabilities of Large Language Models (LLMs), researchers have introduced abundant mathematical reasoning datasets. However, most existing datasets primarily focus o…

Mathematical Reasoning

Automating Mathematical Proof Generation Using Large Language Model Agents and Knowledge Graphs

2025-02-04 · Vincent Li, Yule Fu, Tim Knappe, Kevin Han 외

Large Language Models have demonstrated remarkable capabilities in natural language processing tasks, including mathematical problem-solving that requires multi-step logical reasoning. However, challenges persist in auto…

Formal LogicKnowledge GraphsLanguage ModelingLanguage Modelling+5

PRover: Proof Generation for Interpretable Reasoning over Rules

2020-10-06 · EMNLP 2020 11 · Swarnadeep Saha, Sayan Ghosh, Shashank Srivastava, Mohit Bansal

Recent work by Clark et al. (2020) shows that transformers can act as 'soft theorem provers' by answering questions over explicitly provided knowledge in natural language. In our work, we take a step closer to emulating …

valid