Tribrid: Stance Classification with Neural Inconsistency Detection
We study the problem of performing automatic stance classification on social media with neural architectures such as BERT. Although these architectures deliver impressive results, their level is not yet comparable to the one of humans and they might produce errors that have a significant impact on the downstream task (e.g., fact-checking). To improve the performance, we present a new neural architecture where the input also includes automatically generated negated perspectives over a given claim. The model is jointly learned to make simultaneously multiple predictions, which can be used either to improve the classification of the original perspective or to filter out doubtful predictions. In the first case, we propose a weakly supervised method for combining the predictions into a final one. In the second case, we show that using the confidence scores to remove doubtful predictions allows our method to achieve human-like performance over the retained information, which is still a sizable part of the original input.
Code (1)
Tasks
ClassificationFact CheckingStance ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Metric-aligned Sample Selection and Critical Feature Sampling for Oriented Object Detection
Arbitrary-oriented object detection is a relatively emerging but challenging task. Although remarkable progress has been made, there still remain many unsolved issues due to the large diversity of patterns in orientation…
object-detectionObject DetectionOriented Object DetectionregressionDeep Visual-Linguistic Fusion Network Considering Cross-Modal Inconsistency for Rumor Detection
With the development of internet, users can freely publish posts on various social media, which brings great convenience to keep abreast of the world. However, those posts usually carry a lot of rumors, which require ple…
Bridging Cross-task Protocol Inconsistency for Distillation in Dense Object Detection
Knowledge distillation (KD) has shown potential for learning compact models in dense object detection. However, the commonly used softmax-based distillation ignores the absolute classification scores for individual categ…
Binary ClassificationClassificationDense Object DetectionKnowledge Distillation+3Striking a Balance: Alleviating Inconsistency in Pre-trained Models for Symmetric Classification Tasks
While fine-tuning pre-trained models for downstream classification is the conventional paradigm in NLP, often task-specific nuances may not get captured in the resultant models. Specifically, for tasks that take two inpu…
ClassificationNeural models for Factual Inconsistency Classification with Explanations
Factual consistency is one of the most important requirements when editing high quality documents. It is extremely important for automatic text generation systems like summarization, question answering, dialog modeling, …
8kClassificationLanguage ModelingLanguage Modelling+4