Intrinsic Quality Assessment of Arguments
Several quality dimensions of natural language arguments have been investigated. Some are likely to be reflected in linguistic features (e.g., an argument's arrangement), whereas others depend on context (e.g., relevance) or topic knowledge (e.g., acceptability). In this paper, we study the intrinsic computational assessment of 15 dimensions, i.e., only learning from an argument's text. In systematic experiments with eight feature types on an existing corpus, we observe moderate but significant learning success for most dimensions. Rhetorical quality seems hardest to assess, and subjectivity features turn out strong, although length bias in the corpus impedes full validity. We also find that human assessors differ more clearly to each other than to our approach.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Automatic Argument Quality Assessment - New Datasets and Methods
We explore the task of automatic assessment of argument quality. To that end, we actively collected 6.3k arguments, more than a factor of five compared to previously examined data. Each argument was explicitly and carefu…
Language ModelingLanguage ModellingAutomatic Argument Quality Assessment -- New Datasets and Methods
We explore the task of automatic assessment of argument quality. To that end, we actively collected 6.3k arguments, more than a factor of five compared to previously examined data. Each argument was explicitly and carefu…
Language ModelingLanguage ModellingContextualizing Argument Quality Assessment with Relevant Knowledge
Automatic assessment of the quality of arguments has been recognized as a challenging task with significant implications for misinformation and targeted speech. While real-world arguments are tightly anchored in context,…
MisinformationArgumentation Quality Assessment: Theory vs. Practice
Argumentation quality is viewed differently in argumentation theory and in practical assessment approaches. This paper studies to what extent the views match empirically. We find that most observations on quality phrased…
Argument MiningImproving Quality Assessment of Online Reviews UsingFormal Argumentation Theory and Knowledge Graphs
In this extended abstract, we introduce a previously developed framework for the assessment of the quality of product reviews by using formal argumentation theory and machine learning. Then, we outline current developme…
BIG-bench Machine LearningKnowledge Graphs