paper-with-me

홈 › Papers

Tribrid: Stance Classification with Neural Inconsistency Detection

2021-09-14 · EMNLP 2021 11 · Song Yang, Jacopo Urbani

We study the problem of performing automatic stance classification on social media with neural architectures such as BERT. Although these architectures deliver impressive results, their level is not yet comparable to the one of humans and they might produce errors that have a significant impact on the downstream task (e.g., fact-checking). To improve the performance, we present a new neural architecture where the input also includes automatically generated negated perspectives over a given claim. The model is jointly learned to make simultaneously multiple predictions, which can be used either to improve the classification of the original perspective or to filter out doubtful predictions. In the first case, we propose a weakly supervised method for combining the predictions into a final one. In the second case, we show that using the confidence scores to remove doubtful predictions allows our method to achieve human-like performance over the retained information, which is still a sizable part of the original input.

📄 PDF Abstract BibTeX arXiv:2109.06508

Code (1)

karmaresearch/tribrid 공식 구현 pytorch

Tasks

ClassificationFact CheckingStance Classification

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Weight Decay 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

Metric-aligned Sample Selection and Critical Feature Sampling for Oriented Object Detection

2023-06-29 · Peng Sun, Yongbin Zheng, Wenqi Wu, Wanying Xu 외

Arbitrary-oriented object detection is a relatively emerging but challenging task. Although remarkable progress has been made, there still remain many unsolved issues due to the large diversity of patterns in orientation…

object-detectionObject DetectionOriented Object Detectionregression

Deep Visual-Linguistic Fusion Network Considering Cross-Modal Inconsistency for Rumor Detection

2022-07-08 · Science China Information Sciences 2022 7 · Yang Yang 1, Ran Bao 2, Weili Guo 3, De-Chuan Zhan 4 외

With the development of internet, users can freely publish posts on various social media, which brings great convenience to keep abreast of the world. However, those posts usually carry a lot of rumors, which require ple…

Bridging Cross-task Protocol Inconsistency for Distillation in Dense Object Detection

2023-08-28 · ICCV 2023 1 · Longrong Yang, Xianpan Zhou, XueWei Li, Liang Qiao 외

Knowledge distillation (KD) has shown potential for learning compact models in dense object detection. However, the commonly used softmax-based distillation ignores the absolute classification scores for individual categ…

Binary ClassificationClassificationDense Object DetectionKnowledge Distillation+3

Striking a Balance: Alleviating Inconsistency in Pre-trained Models for Symmetric Classification Tasks

2022-03-25 · Findings (ACL) 2022 5 · Ashutosh Kumar, Aditya Joshi

While fine-tuning pre-trained models for downstream classification is the conventional paradigm in NLP, often task-specific nuances may not get captured in the resultant models. Specifically, for tasks that take two inpu…

Classification

Neural models for Factual Inconsistency Classification with Explanations

2023-06-15 · Tathagata Raha, Mukund Choudhary, Abhinav Menon, Harshit Gupta 외

Factual consistency is one of the most important requirements when editing high quality documents. It is extremely important for automatic text generation systems like summarization, question answering, dialog modeling, …

8kClassificationLanguage ModelingLanguage Modelling+4