paper-with-me

Papers

Contextualizing Argument Quality Assessment with Relevant Knowledge

2023-05-20 · Darshan Deshpande, Zhivar Sourati, Filip Ilievski, Fred Morstatter

Automatic assessment of the quality of arguments has been recognized as a challenging task with significant implications for misinformation and targeted speech. While real-world arguments are tightly anchored in context, existing computational methods analyze their quality in isolation, which affects their accuracy and generalizability. We propose SPARK: a novel method for scoring argument quality based on contextualization via relevant knowledge. We devise four augmentations that leverage large language models to provide feedback, infer hidden assumptions, supply a similar-quality argument, or give a counter-argument. SPARK uses a dual-encoder Transformer architecture to enable the original argument and its augmentation to be considered jointly. Our experiments in both in-domain and zero-shot setups show that SPARK consistently outperforms existing techniques across multiple metrics.

📄 PDF Abstract BibTeX arXiv:2305.12280

Code (1)

usc-isi-i2/forecast-argument 공식 구현 pytorch

Tasks

Misinformation

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Position-Wise Feed-Forward Layer 설명 없음

Similar Papers 제목 키워드 기반

Improving Quality Assessment of Online Reviews UsingFormal Argumentation Theory and Knowledge Graphs

2021-09-13 · AKBC Workshop ArgKG 2021 10 · Anonymous

In this extended abstract, we introduce a previously developed framework for the assessment of the quality of product reviews by using formal argumentation theory and machine learning. Then, we outline current developme…

BIG-bench Machine LearningKnowledge Graphs

Argument Quality Assessment in the Age of Instruction-Following Large Language Models

2024-03-24 · Henning Wachsmuth, Gabriella Lapesa, Elena Cabrio, Anne Lauscher 외

The computational treatment of arguments on controversial issues has been subject to extensive NLP research, due to its envisioned impact on opinion formation, decision making, writing education, and the like. A critical…

Decision MakingDiversityInstruction Following

Intrinsic Quality Assessment of Arguments

2020-10-23 · COLING 2020 8 · Henning Wachsmuth, Till Werner

Several quality dimensions of natural language arguments have been investigated. Some are likely to be reflected in linguistic features (e.g., an argument's arrangement), whereas others depend on context (e.g., relevance…

Employing Argumentation Knowledge Graphs for Neural Argument Generation

2021-08-01 · ACL 2021 5 · Khalid Al Khatib, Lukas Trautner, Henning Wachsmuth, Yufang Hou 외

Generating high-quality arguments, while being challenging, may benefit a wide range of downstream applications, such as writing assistants and argument search engines. Motivated by the effectiveness of utilizing knowled…

Knowledge GraphsText Generation

Similarity-weighted Construction of Contextualized Commonsense Knowledge Graphs for Knowledge-intense Argumentation Tasks

2023-05-15 · Moritz Plenz, Juri Opitz, Philipp Heinisch, Philipp Cimiano 외

Arguments often do not make explicit how a conclusion follows from its premises. To compensate for this lack, we enrich arguments with structured background knowledge to support knowledge-intense argumentation tasks. We …

Knowledge GraphsSemantic SimilaritySemantic Textual SimilarityTriplet