Evaluation of Argument Search Approaches in the Context of Argumentative Dialogue Systems
We present an approach to evaluate argument search techniques in view of their use in argumentative dialogue systems by assessing quality aspects of the retrieved arguments. To this end, we introduce a dialogue system that presents arguments by means of a virtual avatar and synthetic speech to users and allows them to rate the presented content in four different categories (Interesting, Convincing, Comprehensible, Relation). The approach is applied in a user study in order to compare two state of the art argument search engines to each other and with a system based on traditional web search. The results show a significant advantage of the two search engines over the baseline. Moreover, the two search engines show significant advantages over each other in different categories, thereby reflecting strengths and weaknesses of the different underlying techniques.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Argumentative Segmentation Enhancement for Legal Summarization
We use the combination of argumentative zoning [1] and a legal argumentative scheme to create legal argumentative segments. Based on the argumentative segmentation, we propose a novel task of classifying argumentative se…
SegmentationSegmentation of Argumentative Texts with Contextualised Word Representations
The segmentation of argumentative units is an important subtask of argument mining, which is frequently addressed at a coarse granularity, usually assuming argumentative units to be no smaller than sentences. Approaches …
Argument MiningContextualised Word RepresentationsFeature EngineeringAutomated Evaluation for Student Argumentative Writing: A Survey
This paper surveys and organizes research works in an under-studied area, which we call automated evaluation for student argumentative writing. Unlike traditional automated writing evaluation that focuses on holistic ess…
Automated Writing EvaluationSurveyA School Student Essay Corpus for Analyzing Interactions of Argumentative Structure and Quality
Learning argumentative writing is challenging. Besides writing fundamentals such as syntax and grammar, learners must select and arrange argument components meaningfully to create high-quality essays. To support argument…
Argument MiningDissecting Content and Context in Argumentative Relation Analysis
When assessing relations between argumentative units (e.g., support or attack), computational systems often exploit disclosing indicators or markers that are not part of elementary argumentative units (EAUs) themselves, …
Relation