paper-with-me

Papers

An Explicit Syllogistic Legal Reasoning Framework for Large Language Models

2025-04-05 · Kepu Zhang, Weijie Yu, Zhongxiang Sun, Jun Xu

Syllogistic reasoning is crucial for sound legal decision-making, allowing legal professionals to draw logical conclusions by applying general principles to specific case facts. While large language models (LLMs) can answer legal questions, they often struggle with explicit syllogistic reasoning. Their outputs tend to be implicit, unstructured, and consequently, less explainable and trustworthy. To overcome these limitations, we introduce SyLeR, a novel framework designed to enable LLMs to perform explicit syllogistic legal reasoning. SyLeR employs a tree-structured hierarchical retrieval mechanism to synthesize relevant legal statutes and precedents, thereby constructing comprehensive major premises. This is followed by a two-stage fine-tuning process: an initial supervised fine-tuning warm-up establishes a foundational understanding of syllogistic reasoning, while reinforcement learning, guided by a structure-aware reward mechanism, refines the model's capacity to generate diverse, logically sound, and well-structured reasoning paths. We conducted extensive experiments to evaluate SyLeR's performance. Our evaluations spanned diverse dimensions, including both in-domain and cross-domain user groups (legal laypersons and practitioners), multiple languages (Chinese and French), and various LLM backbones (legal-specific and open-domain LLMs). The results consistently demonstrate that SyLeR significantly enhances response accuracy and reliably produces explicit, explainable, and trustworthy legal reasoning.

📄 PDF Abstract BibTeX arXiv:2504.04042

Code (0)

등록된 구현이 없습니다.

Tasks

Legal Reasoning

Similar Papers 제목 키워드 기반

An AI Monkey Gets Grapes for Sure -- Sphere Neural Networks for Reliable Decision-Making

2026-01-01 · Tiansi Dong, Henry He, Pietro Liò, Mateja Jamnik arxiv

This paper compares three methodological categories of neural reasoning: LLM reasoning, supervised learning-based reasoning, and explicit model-based reasoning. LLMs remain unreliable and struggle with simple decision-ma…

Understanding Syllogistic Reasoning in LLMs from Formal and Natural Language Perspectives

2025-12-14 · Aheli Poddar, Saptarshi Sahoo, Sujata Ghosh arxiv

We study syllogistic reasoning in LLMs from the logical and natural language perspectives. In process, we explore fundamental reasoning capabilities of the LLMs and the direction this research is moving forward. To aid i…

Natural Language Understanding

Evaluating Large Language Models with NeuBAROCO: Syllogistic Reasoning Ability and Human-like Biases

2023-06-21 · Risako Ando, Takanobu Morishita, Hirohiko Abe, Koji Mineshima 외

This paper investigates whether current large language models exhibit biases in logical reasoning, similar to humans. Specifically, we focus on syllogistic reasoning, a well-studied form of inference in the cognitive sci…

Logical Reasoning

SR-FoT: A Syllogistic-Reasoning Framework of Thought for Large Language Models Tackling Knowledge-based Reasoning Tasks

2025-01-20 · Wentao Wan, Zhuojie Yang, Yongcan Chen, Chenglin Luo 외

Deductive reasoning is a crucial logical capability that assists us in solving complex problems based on existing knowledge. Although augmented by Chain-of-Thought prompts, Large Language Models (LLMs) might not follow t…

SylloBio-NLI: Evaluating Large Language Models on Biomedical Syllogistic Reasoning

2024-10-18 · Magdalena Wysocka, Danilo S. Carvalho, Oskar Wysocki, Marco Valentino 외

Syllogistic reasoning is crucial for Natural Language Inference (NLI). This capability is particularly significant in specialized domains such as biomedicine, where it can support automatic evidence interpretation and sc…

Natural Language Inferencescientific discoveryvalid