paper-with-me

홈 › Papers

NLP@JUST at SemEval-2020 Task 4: Ensemble Technique for BERT and Roberta to Evaluate Commonsense Validation

2020-12-01 · SEMEVAL 2020 · Emran Al-Bashabsheh, Ayah Abu Aqouleh, Mohammad AL-Smadi

This paper presents the work of the NLP@JUST team at SemEval-2020 Task 4 competition that related to commonsense validation and explanation (ComVE) task. The team participates in sub-taskA (Validation) which related to validation that checks if the text is against common sense or not. Several models have trained (\textit{i.e. Bert, XLNet, and Roberta}), however, the main models used are the RoBERTa-large and BERT Whole word masking. As well as, we utilized the results from both models to generate final prediction by using the average Ensemble technique, that used to improve the overall performance. The evaluation result shows that the implemented model achieved an accuracy of 93.9{\%} obtained and published at the post-evaluation result on the leaderboard.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Common Sense Reasoning

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Attention 설명 없음
Adam 설명 없음
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
SentencePiece 설명 없음
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

QiaoNing at SemEval-2020 Task 4: Commonsense Validation and Explanation system based on ensemble of language model

2020-09-06 · SEMEVAL 2020 · Pai Liu

In this paper, we present language model system submitted to SemEval-2020 Task 4 competition: "Commonsense Validation and Explanation". We participate in two subtasks for subtask A: validation and subtask B: Explanation.…

Language ModelingLanguage ModellingTransfer Learning

SheffieldVeraAI at SemEval-2023 Task 3: Mono and multilingual approaches for news genre, topic and persuasion technique classification

2023-03-16 · Ben Wu, Olesya Razuvayevskaya, Freddy Heppell, João A. Leite 외

This paper describes our approach for SemEval-2023 Task 3: Detecting the category, the framing, and the persuasion techniques in online news in a multi-lingual setup. For Subtask 1 (News Genre), we propose an ensemble of…

UMSIForeseer at SemEval-2020 Task 11: Propaganda Detection by Fine-Tuning BERT with Resampling and Ensemble Learning

2020-12-01 · SEMEVAL 2020 · Yunzhe Jiang, Cristina Garbacea, Qiaozhu Mei

We describe our participation at the SemEval 2020 {``}Detection of Propaganda Techniques in News Articles{''} - Techniques Classification (TC) task, designed to categorize textual fragments into one of the 14 given propa…

ArticlesEnsemble LearningPropaganda detection

KEIS@JUST at SemEval-2020 Task 12: Identifying Multilingual Offensive Tweets Using Weighted Ensemble and Fine-Tuned BERT

2020-05-15 · SEMEVAL 2020 · Saja Khaled Tawalbeh, Mahmoud Hammad, Mohammad AL-Smadi

This research presents our team KEIS@JUST participation at SemEval-2020 Task 12 which represents shared task on multilingual offensive language. We participated in all the provided languages for all subtasks except sub-t…

Data AugmentationTransfer Learning

TTUI at SemEval-2020 Task 11: Propaganda Detection with Transfer Learning and Ensembles

2020-12-01 · SEMEVAL 2020 · Moonsung Kim, Steven Bethard

In this paper, we describe our approaches and systems for the SemEval-2020 Task 11 on propaganda technique detection. We fine-tuned BERT and RoBERTa pre-trained models then merged them with an average ensemble. We conduc…

Propaganda detectionTransfer Learning