Can Large Language Models perform Relation-based Argument Mining?
Argument mining (AM) is the process of automatically extracting arguments, their components and/or relations amongst arguments and components from text. As the number of platforms supporting online debate increases, the need for AM becomes ever more urgent, especially in support of downstream tasks. Relation-based AM (RbAM) is a form of AM focusing on identifying agreement (support) and disagreement (attack) relations amongst arguments. RbAM is a challenging classification task, with existing methods failing to perform satisfactorily. In this paper, we show that general-purpose Large Language Models (LLMs), appropriately primed and prompted, can significantly outperform the best performing (RoBERTa-based) baseline. Specifically, we experiment with two open-source LLMs (Llama-2 and Mistral) with ten datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Argument MiningRelationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Assisted Debate Builder with Large Language Models
We introduce ADBL2, an assisted debate builder tool. It is based on the capability of large language models to generalise and perform relation-based argument mining in a wide-variety of domains. It is the first open-sour…
Argument MiningLanguage ModelingLanguage ModellingLarge Language Model+1Assessing Open-Source Large Language Models on Argumentation Mining Subtasks
We explore the capability of four open-sourcelarge language models (LLMs) in argumentation mining (AM). We conduct experiments on three different corpora; persuasive essays(PE), argumentative microtexts (AMT) Part 1 and …
ARCRelation ClassificationUsing Complex Argumentative Interactions to Reconstruct the Argumentative Structure of Large-Scale Debates
In this paper we consider the insights that can be gained by considering large scale argument networks and the complex interactions between their constituent propositions. We investigate metrics for analysing properties …
Argument MiningDecision MakingAMPERSAND: Argument Mining for PERSuAsive oNline Discussions
Argumentation is a type of discourse where speakers try to persuade their audience about the reasonableness of a claim by presenting supportive arguments. Most work in argument mining has focused on modeling arguments in…
Argument MiningLanguage ModelingLanguage ModellingRelation PredictionLLMs for Argument Mining: Detection, Extraction, and Relationship Classification of pre-defined Arguments in Online Comments
Automated large-scale analysis of public discussions around contested issues like abortion requires detecting and understanding the use of arguments. While Large Language Models (LLMs) have shown promise in language proc…
Argument Mining