paper-with-me

홈 › Papers

Leveraging LLMs for Hypothetical Deduction in Logical Inference: A Neuro-Symbolic Approach

2024-10-29 · Qingchuan Li, Jiatong Li, Tongxuan Liu, Yuting Zeng, Mingyue Cheng, Weizhe Huang, Qi Liu

Large Language Models (LLMs) have exhibited remarkable potential across a wide array of reasoning tasks, including logical reasoning. Although massive efforts have been made to empower the logical reasoning ability of LLMs via external logical symbolic solvers, crucial challenges of the poor generalization ability to questions with different features and inevitable question information loss of symbolic solver-driven approaches remain unresolved. To mitigate these issues, we introduce LINA, a LLM-driven neuro-symbolic approach for faithful logical reasoning. By enabling an LLM to autonomously perform the transition from propositional logic extraction to sophisticated logical reasoning, LINA not only bolsters the resilience of the reasoning process but also eliminates the dependency on external solvers. Additionally, through its adoption of a hypothetical-deductive reasoning paradigm, LINA effectively circumvents the expansive search space challenge that plagues traditional forward reasoning methods. Empirical evaluations demonstrate that LINA substantially outperforms both established propositional logic frameworks and conventional prompting techniques across a spectrum of five logical reasoning tasks. Specifically, LINA achieves an improvement of 24.34% over LINC on the FOLIO dataset, while also surpassing prompting strategies like CoT and CoT-SC by up to 24.02%. Our code is available at https://github.com/wufeiwuwoshihua/nshy.

📄 PDF Abstract BibTeX arXiv:2410.21779

Code (1)

wufeiwuwoshihua/nshy 공식 구현

Tasks

Logical Reasoning

Similar Papers 제목 키워드 기반

Learning Deductive Reasoning from Synthetic Corpus based on Formal Logic

2023-08-11 · Terufumi Morishita, Gaku Morio, Atsuki Yamaguchi, Yasuhiro Sogawa

We study a synthetic corpus based approach for language models (LMs) to acquire logical deductive reasoning ability. The previous studies generated deduction examples using specific sets of deduction rules. However, thes…

Formal LogicLogical Reasoning

Non-Interactive Symbolic-Aided Chain-of-Thought for Logical Reasoning

2025-08-17 · Phuong Minh Nguyen, Tien Huu Dang, Naoya Inoue arxiv

This work introduces Symbolic-Aided Chain-of-Thought (CoT), an improved approach to standard CoT, for logical reasoning in large language models (LLMs). The key idea is to integrate lightweight symbolic representations i…

Logical Reasoning

Testing the General Deductive Reasoning Capacity of Large Language Models Using OOD Examples

2023-05-24 · NeurIPS 2023 11 · Abulhair Saparov, Richard Yuanzhe Pang, Vishakh Padmakumar, Nitish Joshi 외

Given the intractably large size of the space of proofs, any model that is capable of general deductive reasoning must generalize to proofs of greater complexity. Recent studies have shown that large language models (LLM…

Human-Level Reasoning: A Comparative Study of Large Language Models on Logical and Abstract Reasoning

2025-10-28 · Benjamin Grando Moreira arxiv

Evaluating reasoning ability in Large Language Models (LLMs) is important for advancing artificial intelligence, as it transcends mere linguistic task performance. It involves understanding whether these models truly und…

Deduction under Perturbed Evidence: Probing Student Simulation Capabilities of Large Language Models

2023-05-23 · Shashank Sonkar, Richard G. Baraniuk

We explore whether Large Language Models (LLMs) are capable of logical reasoning with distorted facts, which we call Deduction under Perturbed Evidence (DUPE). DUPE presents a unique challenge to LLMs since they typicall…

Logical ReasoningStrategyQAvalid