paper-with-me

Papers

Follow My Lead: Logical Fallacy Classification with Knowledge-Augmented LLMs

2025-10-11 · Olivia Peiyu Wang, Tashvi Bansal, Ryan Bai, Emily M. Chui, Leilani H. Gilpin arxiv

Large Language Models (LLMs) suffer from critical reasoning gaps, including a tendency to hallucinate and poor accuracy in classifying logical fallacies. This limitation stems from their default System 1 processing, which is fast and intuitive, whereas reliable reasoning requires the deliberate, effortful System 2 approach (Kahneman, 2011; Li et al., 2025). Since full System 2 training is often prohibitively expensive, we explore a low-cost, instruction-based intervention to bridge this gap. Our methodology introduces a novel stepwise instruction dataset that decomposes fallacy classification into a series of atomic procedural steps (simple binary questions). We further augment this with a final verification step where models consult a relational knowledge graph of related fallacies. This procedural, rule-based intervention yields a significant improvement in LLM logical fallacy classification. Crucially, the approach also provides enhanced transparency into the LLMs' decision-making, highlighting a practical pathway for Neuro-symbolic architectures to address LLM reasoning deficits.

📄 PDF Abstract BibTeX arXiv:2510.09970

Code (0)

등록된 구현이 없습니다.

Tasks

Logical Fallacies

Similar Papers 제목 키워드 기반

Joint Effects of Argumentation Theory, Audio Modality and Data Enrichment on LLM-Based Fallacy Classification

2025-09-14 · Hongxu Zhou, Hylke Westerdijk, Khondoker Ittehadul Islam arxiv

This study investigates how context and emotional tone metadata influence large language model (LLM) reasoning and performance in fallacy classification tasks, particularly within political debate settings. Using data fr…

Logical Reasoning

A Logical Fallacy-Informed Framework for Argument Generation

2024-08-07 · Luca Mouchel, Debjit Paul, Shaobo Cui, Robert West 외

Despite the remarkable performance of Large Language Models (LLMs) in natural language processing tasks, they still struggle with generating logically sound arguments, resulting in potential risks such as spreading misin…

Logical FallaciesMisinformation

Boosting Logical Fallacy Reasoning in LLMs via Logical Structure Tree

2024-10-15 · Yuanyuan Lei, Ruihong Huang

Logical fallacy uses invalid or faulty reasoning in the construction of a statement. Despite the prevalence and harmfulness of logical fallacies, detecting and classifying logical fallacies still remains a challenging ta…

Logical FallaciesRelation

Leveraging Context for Multimodal Fallacy Classification in Political Debates

2025-07-21 · Alessio Pittiglio

In this paper, we present our submission to the MM-ArgFallacy2025 shared task, which aims to advance research in multimodal argument mining, focusing on logical fallacies in political debates. Our approach uses pretraine…

Argument MiningLogical Fallacies

Truth or Sophistry? LoFa: A Benchmark for LLM Robustness Against Logical Fallacies

2026-06-30 · Xudong Shen, Li Yuan, Ye Chen, Xin Wu 외 arxiv

Large Language Models (LLMs) exhibit strong semantic capabilities, yet their resilience to manipulative linguistic patterns such as logical fallacies remains underexplored. Prior work has primarily examined whether LLMs …

Logical Fallacies